Jul 01 18:05:37.768845 ip-10-0-136-158 systemd[1]: Starting Kubernetes Kubelet...
Jul 01 18:05:38.551077 ip-10-0-136-158 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 18:05:38.551077 ip-10-0-136-158 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 01 18:05:38.551077 ip-10-0-136-158 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 18:05:38.551077 ip-10-0-136-158 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 01 18:05:38.551077 ip-10-0-136-158 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 18:05:38.552116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.552031    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 01 18:05:38.557058 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557042    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:05:38.557058 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557058    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557062    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557065    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557069    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557072    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557075    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557078    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557081    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557085    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557088    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557090    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557093    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557096    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557098    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557100    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557103    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557106    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557109    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557111    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557114    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:05:38.557125 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557117    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557119    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557122    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557124    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557127    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557130    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557133    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557135    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557138    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557141    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557143    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557146    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557149    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557152    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557154    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557157    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557160    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557163    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557165    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557168    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:05:38.557608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557170    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557173    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557175    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557178    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557180    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557183    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557186    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557188    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557191    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557193    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557196    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557198    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557201    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557204    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557207    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557210    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557212    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557215    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557218    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:05:38.558075 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557221    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557223    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557227    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557231    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557234    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557237    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557240    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557244    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557247    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557251    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557254    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557256    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557259    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557262    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557265    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557267    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557271    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557275    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557278    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:05:38.558537 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557280    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557283    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557285    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557288    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557290    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557293    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557296    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557300    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557304    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557308    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557311    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557314    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557317    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557320    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557323    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557326    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557329    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557332    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557334    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:05:38.559086 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.557337    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558054    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558062    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558066    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558069    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558072    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558075    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558078    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558081    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558083    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558086    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558089    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558092    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558094    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558097    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558099    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558102    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558105    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558107    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:05:38.559738 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558109    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558112    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558116    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558119    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558121    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558124    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558127    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558129    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558132    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558134    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558137    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558139    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558142    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558144    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558147    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558150    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558152    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558155    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558158    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558160    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:05:38.560196 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558163    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558165    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558168    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558170    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558173    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558176    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558178    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558181    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558183    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558188    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558191    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558194    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558197    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558199    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558203    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558205    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558208    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558210    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558213    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:05:38.560786 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558215    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558218    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558221    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558223    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558226    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558228    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558231    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558234    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558236    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558239    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558241    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558244    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558253    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558256    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558258    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558261    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558263    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558266    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558269    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558271    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:05:38.561237 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558274    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558276    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558279    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558283    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558287    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558289    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558292    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558296    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558299    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558303    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558305    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558308    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558310    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558313    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558315    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558318    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558321    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558323    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558325    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:05:38.561726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558328    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558330    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.558333    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559941    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559953    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559957    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559960    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559963    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559966    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559968    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559971    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559973    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559976    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559978    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559981    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559984    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559986    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559989    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559991    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559994    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:05:38.562192 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559996    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.559999    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560002    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560004    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560007    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560009    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560012    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560014    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560017    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560023    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560026    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560028    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560031    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560033    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560036    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560039    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560042    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560045    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560047    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560050    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:05:38.562679 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560052    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560056    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560060    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560063    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560066    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560068    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560071    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560073    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560076    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560078    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560081    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560083    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560087    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560089    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560092    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560095    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560097    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560100    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560103    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:05:38.563144 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560106    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560109    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560111    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560114    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560116    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560119    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560122    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560124    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560127    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560129    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560132    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560135    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560138    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560141    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560143    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560146    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560149    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560151    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560154    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560157    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:05:38.563639 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560159    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560162    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560164    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560166    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560169    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560173    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560177    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560188    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560191    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560193    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560196    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560200    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560206    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560209    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560212    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560216    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560219    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560222    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560225    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:05:38.564096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560227    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560234    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560237    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.560239    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560309    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560317    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560326    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560332    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560338    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560344    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560352    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560356    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560359    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560362    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560366    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560369    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560373    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560376    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560379    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560382    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560385    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560395    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560401    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560404    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 01 18:05:38.564563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560407    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560410    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560414    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560418    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560421    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560424    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560427    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560430    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560433    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560439    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560443    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560446    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560450    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560453    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560456    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560458    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560461    2555 flags.go:64] FLAG: --enable-server="true"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560464    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560469    2555 flags.go:64] FLAG: --event-burst="100"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560472    2555 flags.go:64] FLAG: --event-qps="50"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560474    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560477    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560480    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560484    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 01 18:05:38.565159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560487    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560490    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560493    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560496    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560499    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560502    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560505    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560508    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560511    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560514    2555 flags.go:64] FLAG: --feature-gates=""
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560518    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560534    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560538    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560541    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560544    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560547    2555 flags.go:64] FLAG: --help="false"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560550    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560556    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560559    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560562    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560565    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560569    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560571    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 01 18:05:38.565742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560574    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560577    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560580    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560583    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560586    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560589    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560592    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560594    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560597    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560600    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560603    2555 flags.go:64] FLAG: --lock-file=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560606    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560609    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560611    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560617    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560620    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560628    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560631    2555 flags.go:64] FLAG: --logging-format="text"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560633    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560637    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560639    2555 flags.go:64] FLAG: --manifest-url=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560642    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560646    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560649    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560653    2555 flags.go:64] FLAG: --max-pods="110"
Jul 01 18:05:38.566325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560656    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560661    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560664    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560667    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560670    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560673    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560675    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560684    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560687    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560690    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560693    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560695    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560701    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560704    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560707    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560710    2555 flags.go:64] FLAG: --port="10250"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560713    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560716    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0187d20514fc1aca5"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560719    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560723    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560726    2555 flags.go:64] FLAG: --register-node="true"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560728    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560732    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560735    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 01 18:05:38.566949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560738    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560741    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560745    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560749    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560752    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560754    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560757    2555 flags.go:64] FLAG: --runonce="false"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560760    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560763    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560767    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560771    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560774    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560777    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560780    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560783    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560786    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560789    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560792    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560795    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560798    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560802    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560805    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560810    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560813    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560815    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 01 18:05:38.567510 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560820    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560822    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560825    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560828    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560831    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560834    2555 flags.go:64] FLAG: --v="2"
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560838    2555 flags.go:64] FLAG: --version="false"
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560842    2555 flags.go:64] FLAG: --vmodule=""
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560846    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.560849    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561001    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561006    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561009    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561012    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561016    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561019    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561024    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561030    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561034    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561038    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561041    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:05:38.568121 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561044    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561046    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561049    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561051    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561054    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561056    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561059    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561061    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561064    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561067    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561069    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561072    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561074    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561077    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561081    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561083    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561086    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561088    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561091    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:05:38.568670 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561093    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561096    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561099    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561101    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561105    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561109    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561112    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561115    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561119    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561123    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561126    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561129    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561132    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561134    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561137    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561140    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561142    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561145    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561148    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:05:38.569127 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561151    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561153    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561155    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561158    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561161    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561163    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561166    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561168    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561171    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561173    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561176    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561179    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561181    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561184    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561186    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561189    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561192    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561194    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561197    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:05:38.569608 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561199    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561202    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561205    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561210    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561213    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561216    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561218    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561221    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561223    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561226    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561228    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561231    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561233    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561236    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561239    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561241    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561244    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561247    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561249    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561252    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:05:38.570061 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561255    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561257    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561260    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561262    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561265    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561267    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561269    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561272    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561275    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561278    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.561281    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.561286    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.567657    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.567674    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.567694    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 01 18:05:38.570564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.567700    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567757    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567762    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567766    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567769    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567771    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567774    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567777    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567779    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567782    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567785    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567787    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567790    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567793    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567796    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567798    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567801    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567803    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567806    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567810    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:05:38.570925 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567813    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567816    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567819    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567821    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567824    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567827    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567829    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567833    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567835    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567838    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567842    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567845    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567847    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567850    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567852    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567855    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567857    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567860    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567863    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567865    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:05:38.571388 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567868    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567870    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567873    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567876    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567878    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567881    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567883    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567886    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567889    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567891    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567894    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567897    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567900    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567902    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567905    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567907    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567910    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567913    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567915    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567918    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:05:38.571873 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567921    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567925    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567928    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567932    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567935    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567938    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567940    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567943    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567945    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567948    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567952    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567956    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567959    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567961    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567964    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567967    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567969    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567972    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567975    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:05:38.572341 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567977    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567980    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567982    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567985    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567988    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567990    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567993    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567995    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.567998    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568001    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568003    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568006    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568008    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568011    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568013    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568017    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568019    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568023    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568026    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:05:38.572800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568028    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568031    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.568036    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568168    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568173    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568176    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568179    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568182    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568184    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568187    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568190    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568193    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568195    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568198    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:05:38.573264 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568200    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568203    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568206    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568208    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568211    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568213    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568215    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568218    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568220    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568223    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568226    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568228    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568231    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568234    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568237    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568239    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568242    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568245    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568247    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568250    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:05:38.573638 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568253    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568257    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568260    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568262    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568265    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568267    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568270    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568272    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568275    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568277    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568280    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568282    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568285    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568287    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568290    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568292    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568294    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568298    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568301    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568304    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:05:38.574120 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568307    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568310    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568313    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568316    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568319    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568322    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568325    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568328    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568330    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568333    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568336    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568339    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568341    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568343    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568346    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568349    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568352    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568355    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568358    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:05:38.574629 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568361    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568364    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568367    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568369    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568372    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568374    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568377    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568380    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568382    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568384    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568387    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568402    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568406    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568409    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568412    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568415    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568418    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568421    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568424    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568426    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:05:38.575090 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568429    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568431    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568434    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568437    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568440    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568443    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568446    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568448    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:38.568450    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.568455    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.568579    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.570556    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.571816    2555 server.go:1019] "Starting client certificate rotation"
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.571915    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 18:05:38.575685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.572722    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 18:05:38.576168 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.575021    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 18:05:38.577849 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.577823    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 18:05:38.589004 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.588986    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 01 18:05:38.591040 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.591023    2555 log.go:25] "Validated CRI v1 image API"
Jul 01 18:05:38.591760 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.591739    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 01 18:05:38.594821 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.594803    2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85bd5708-21f5-45c2-b6a3-fd30371769cd:/dev/nvme0n1p3 c84ffbca-e468-4e21-a60a-dc7c9e3bd47c:/dev/nvme0n1p4]
Jul 01 18:05:38.594893 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.594821    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 01 18:05:38.600785 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.600669    2555 manager.go:216] Machine: {Timestamp:2026-07-01 18:05:38.599581552 +0000 UTC m=+0.711157014 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098963 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26da4a21b1d95c5bf7052f7aea88eb SystemUUID:ec26da4a-21b1-d95c-5bf7-052f7aea88eb BootID:6cacc323-27a1-47f1-a0aa-9df3ee7f98ce Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:cd:52:b5:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:cd:52:b5:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:09:2b:00:fc:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 01 18:05:38.600785 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.600774    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 01 18:05:38.600909 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.600890    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 01 18:05:38.603943 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.603915    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 01 18:05:38.604076 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.603945    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 01 18:05:38.604787 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.604776    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 01 18:05:38.604820 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.604789    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 01 18:05:38.604820 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.604796    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 18:05:38.605515 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.605504    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 18:05:38.606429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.606418    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 01 18:05:38.607052 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.607036    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 18:05:38.609228 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609217    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 18:05:38.609344 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609335    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 01 18:05:38.609384 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609364    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 01 18:05:38.609384 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609375    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 01 18:05:38.609434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609386    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 01 18:05:38.609434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609395    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 01 18:05:38.609434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609403    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 01 18:05:38.609775 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609764    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 18:05:38.609818 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.609782    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 18:05:38.612417 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.612403    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 01 18:05:38.613812 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.613799    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 01 18:05:38.613853 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.613829    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 01 18:05:38.614441 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614429    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 01 18:05:38.614488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614447    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 01 18:05:38.614488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614454    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 01 18:05:38.614488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614459    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 01 18:05:38.614488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614466    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 01 18:05:38.614488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614472    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 01 18:05:38.614633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614544    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 01 18:05:38.614633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614551    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 01 18:05:38.614633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614557    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 01 18:05:38.614633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614562    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 01 18:05:38.614633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614571    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 01 18:05:38.614633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.614579    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 01 18:05:38.616304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.616292    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 01 18:05:38.616304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.616303    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 01 18:05:38.619482 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.619467    2555 server.go:1268] "Started kubelet"
Jul 01 18:05:38.619637 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.619566    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 01 18:05:38.619731 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.619634    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 01 18:05:38.619774 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.619743    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 01 18:05:38.620377 ip-10-0-136-158 systemd[1]: Started Kubernetes Kubelet.
Jul 01 18:05:38.621102 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.620888    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 01 18:05:38.621901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.621886    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 01 18:05:38.623756 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.623738    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 01 18:05:38.625900 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.625874    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 01 18:05:38.625969 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.625912    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 01 18:05:38.626014 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.625985    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 01 18:05:38.626893 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.625938    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-158.ec2.internal.18be3c9aef1ad2ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-158.ec2.internal,UID:ip-10-0-136-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-158.ec2.internal,},FirstTimestamp:2026-07-01 18:05:38.619437754 +0000 UTC m=+0.731013217,LastTimestamp:2026-07-01 18:05:38.619437754 +0000 UTC m=+0.731013217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-158.ec2.internal,}"
Jul 01 18:05:38.627643 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.627600    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdx8d"
Jul 01 18:05:38.628579 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.628560    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 01 18:05:38.628663 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.628583    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 01 18:05:38.629272 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.629004    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:38.629585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629563    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 01 18:05:38.629585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629575    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 01 18:05:38.629731 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629598    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 01 18:05:38.629731 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629670    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 01 18:05:38.629731 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629681    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 01 18:05:38.629864 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629731    2555 factory.go:55] Registering systemd factory
Jul 01 18:05:38.629864 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.629746    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 01 18:05:38.630187 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.630037    2555 factory.go:153] Registering CRI-O factory
Jul 01 18:05:38.630187 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.630051    2555 factory.go:223] Registration of the crio container factory successfully
Jul 01 18:05:38.630187 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.630091    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 01 18:05:38.630187 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.630112    2555 factory.go:103] Registering Raw factory
Jul 01 18:05:38.630187 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.630126    2555 manager.go:1196] Started watching for new ooms in manager
Jul 01 18:05:38.630512 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.630496    2555 manager.go:349] Starting recovery of all containers
Jul 01 18:05:38.630719 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.630694    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 01 18:05:38.631122 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.631099    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 01 18:05:38.634517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.634493    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kdx8d"
Jul 01 18:05:38.640766 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.640751    2555 manager.go:354] Recovery completed
Jul 01 18:05:38.645056 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.645043    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.647051 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647036    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.647112 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647063    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.647112 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647074    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.647738 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647725    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 01 18:05:38.647738 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647737    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 01 18:05:38.647833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647744    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.647833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.647752    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 18:05:38.648382 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.648369    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.648438 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.648395    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.648438 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.648404    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.649605 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.649593    2555 policy_none.go:49] "None policy: Start"
Jul 01 18:05:38.649639 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.649610    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 01 18:05:38.649639 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.649620    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 01 18:05:38.650983 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.650972    2555 policy_none.go:47] "Start"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.687915    2555 manager.go:337] "Starting Device Plugin manager"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.688101    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.688113    2555 server.go:87] "Starting device plugin registration server"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.688357    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.688369    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.688467    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.688586    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.688595    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.689249    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.689299    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.695352    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.696584    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.696621    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.696639    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 01 18:05:38.698065 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.696669    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 01 18:05:38.698824 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.698808    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:05:38.788941 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.788893    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.790165 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.790142    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.790286 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.790185    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.790286 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.790200    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.790286 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.790222    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.797500 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.797482    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"]
Jul 01 18:05:38.797577 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.797561    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.798688 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.798674    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.798747 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.798695    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-158.ec2.internal\": node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:38.799138 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.799117    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.799226 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.799147    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.799226 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.799157    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.800468 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.800455    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.800585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.800572    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.800624 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.800606    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.802225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.801501    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.802225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.801548    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.802225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.801565    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.802225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.801672    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.802225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.801691    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.802225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.801703    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.802949 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.802928    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.803020 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.802955    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:05:38.803770 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.803755    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:05:38.803842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.803783    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:05:38.803842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.803796    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:05:38.810657 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.810643    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:38.826199 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.826180    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-158.ec2.internal\" not found" node="ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.830642 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.830626    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-158.ec2.internal\" not found" node="ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.831613 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.831597    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663095724dbf6c956fd8fb13b67b529a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal\" (UID: \"663095724dbf6c956fd8fb13b67b529a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.831687 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.831627    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be78b4b5448f62b72b8455220a367a2d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-158.ec2.internal\" (UID: \"be78b4b5448f62b72b8455220a367a2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.831687 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.831661    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/663095724dbf6c956fd8fb13b67b529a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal\" (UID: \"663095724dbf6c956fd8fb13b67b529a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.911629 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:38.911551    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:38.931953 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.931922    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/663095724dbf6c956fd8fb13b67b529a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal\" (UID: \"663095724dbf6c956fd8fb13b67b529a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.931953 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.931950    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663095724dbf6c956fd8fb13b67b529a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal\" (UID: \"663095724dbf6c956fd8fb13b67b529a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.932117 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.931968    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be78b4b5448f62b72b8455220a367a2d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-158.ec2.internal\" (UID: \"be78b4b5448f62b72b8455220a367a2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.932117 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.932017    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/663095724dbf6c956fd8fb13b67b529a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal\" (UID: \"663095724dbf6c956fd8fb13b67b529a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.932117 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.932020    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/663095724dbf6c956fd8fb13b67b529a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal\" (UID: \"663095724dbf6c956fd8fb13b67b529a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:38.932117 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:38.932065    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be78b4b5448f62b72b8455220a367a2d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-158.ec2.internal\" (UID: \"be78b4b5448f62b72b8455220a367a2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:39.012484 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.012438    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.113272 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.113239    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.129423 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.129396    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:39.134698 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.134672    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:39.214395 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.214309    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.314946 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.314914    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.415422 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.415381    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.516037 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.515966    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.571481 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.571449    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 01 18:05:39.572005 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.571661    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 18:05:39.616981 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.616953    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.628227 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:39.628200    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe78b4b5448f62b72b8455220a367a2d.slice/crio-7e5ecd009d791f891cf609d4a533b6941bdbad1b652be431dfe8b9fe8f94a055 WatchSource:0}: Error finding container 7e5ecd009d791f891cf609d4a533b6941bdbad1b652be431dfe8b9fe8f94a055: Status 404 returned error can't find the container with id 7e5ecd009d791f891cf609d4a533b6941bdbad1b652be431dfe8b9fe8f94a055
Jul 01 18:05:39.628763 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:39.628739    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663095724dbf6c956fd8fb13b67b529a.slice/crio-ca32035b1f08fabbf183ac7544fdfc656b1ffa33a2f41993eb9305a34b6ddc0a WatchSource:0}: Error finding container ca32035b1f08fabbf183ac7544fdfc656b1ffa33a2f41993eb9305a34b6ddc0a: Status 404 returned error can't find the container with id ca32035b1f08fabbf183ac7544fdfc656b1ffa33a2f41993eb9305a34b6ddc0a
Jul 01 18:05:39.636077 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.636055    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:05:39.639285 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.639259    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:00:39 +0000 UTC" deadline="2028-02-11 04:40:13.950053029 +0000 UTC"
Jul 01 18:05:39.639285 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.639285    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14146h34m34.310771362s"
Jul 01 18:05:39.700016 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.699960    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal" event={"ID":"663095724dbf6c956fd8fb13b67b529a","Type":"ContainerStarted","Data":"ca32035b1f08fabbf183ac7544fdfc656b1ffa33a2f41993eb9305a34b6ddc0a"}
Jul 01 18:05:39.700903 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.700881    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal" event={"ID":"be78b4b5448f62b72b8455220a367a2d","Type":"ContainerStarted","Data":"7e5ecd009d791f891cf609d4a533b6941bdbad1b652be431dfe8b9fe8f94a055"}
Jul 01 18:05:39.718051 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.718028    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.780757 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:39.780699    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:05:39.818784 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.818758    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:39.919908 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:39.919866    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:40.020767 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.020729    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:40.121917 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.121821    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-158.ec2.internal\" not found"
Jul 01 18:05:40.167534 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.167503    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:05:40.216683 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.216649    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:05:40.229965 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.229935    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:40.241213 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.241169    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 18:05:40.242381 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.242356    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal"
Jul 01 18:05:40.251056 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.251032    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 18:05:40.406621 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.406523    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:05:40.610830 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.610801    2555 apiserver.go:52] "Watching apiserver"
Jul 01 18:05:40.620102 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.620076    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 01 18:05:40.620511 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.620478    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-pd8v9","openshift-multus/network-metrics-daemon-gkpld","openshift-network-operator/iptables-alerter-tg99j","kube-system/global-pull-secret-syncer-45glq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l","openshift-cluster-node-tuning-operator/tuned-4xrg4","openshift-dns/node-resolver-cwvg4","openshift-network-diagnostics/network-check-target-tztrj","openshift-ovn-kubernetes/ovnkube-node-xrzqw","kube-system/konnectivity-agent-5v7mh","kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal","openshift-image-registry/node-ca-dwx5g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal","openshift-multus/multus-additional-cni-plugins-7hj6g"]
Jul 01 18:05:40.622512 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.622493    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.623825 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.623799    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:40.623943 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.623885    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:40.625308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.625018    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8kbc8\""
Jul 01 18:05:40.625308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.625060    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.625308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.625125    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.625308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.625154    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.626586 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.626566    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.626697 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.626638    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:40.627709 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.627688    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 01 18:05:40.627876 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.627862    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.628046 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.628029    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.628102 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.628066    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kp4m4\""
Jul 01 18:05:40.628475 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.628452    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.629929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.629910    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 01 18:05:40.630193 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.630171    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.630880 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.630860    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 01 18:05:40.630987 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.630863    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t5g8q\""
Jul 01 18:05:40.631297 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.631244    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.631396 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.631304    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.632135 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.631951    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.632696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.632675    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.632798 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.632740    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.633023 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.633003    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rlrdh\""
Jul 01 18:05:40.633359 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.633307    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.634200 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.634177    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.634480 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.634463    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nrdxc\""
Jul 01 18:05:40.634480 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.634472    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 01 18:05:40.634696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.634474    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.634696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.634478    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 01 18:05:40.635040 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.634978    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:40.635157 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.635040    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:40.635157 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635056    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 01 18:05:40.635470 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635452    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 01 18:05:40.635765 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635743    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.635765 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635764    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g9wpm\""
Jul 01 18:05:40.635911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635797    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 01 18:05:40.635911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635803    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 01 18:05:40.636022 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.635951    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.636782 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.636765    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.638514 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.638493    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.638958 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.638939    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 01 18:05:40.639184 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.639160    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 01 18:05:40.639280 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.639204    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqvnb\""
Jul 01 18:05:40.640073 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.640049    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.640900 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.640851    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 01 18:05:40.641651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.641301    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 01 18:05:40.641651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.641320    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nchgf\""
Jul 01 18:05:40.642175 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.642149    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 01 18:05:40.643487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.643085    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 01 18:05:40.643487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.643215    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4ngln\""
Jul 01 18:05:40.643487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.643266    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 01 18:05:40.643715 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.643615    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644085    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysconfig\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644123    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-lib-modules\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644338    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-var-lib-kubelet\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644377    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-tmp\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644446    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-registration-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644483    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-device-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644564    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysctl-d\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644658    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644691    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-host-slash\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-sys-fs\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644764    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-systemd\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644824    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-run\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644860    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-hosts-file\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644910    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zsj\" (UniqueName: \"kubernetes.io/projected/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-kube-api-access-z4zsj\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.645615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644942    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbxps\" (UniqueName: \"kubernetes.io/projected/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-kube-api-access-nbxps\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.644985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-modprobe-d\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645019    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-host\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645065    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d2f3640b-50fa-44a1-88ac-91110982cd62-kubelet-config\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645098    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645130    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-socket-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645174    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-tuned\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645206    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxw5s\" (UniqueName: \"kubernetes.io/projected/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-kube-api-access-jxw5s\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645264    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d2f3640b-50fa-44a1-88ac-91110982cd62-dbus\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645350    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-kubernetes\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysctl-conf\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645446    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-sys\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645584    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-iptables-alerter-script\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645641    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66xc\" (UniqueName: \"kubernetes.io/projected/f629de12-6f17-47a4-bdf9-0bedd5b00327-kube-api-access-v66xc\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.646372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.645677    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-tmp-dir\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.664959 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.664936    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-79sfs"
Jul 01 18:05:40.672575 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.672554    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-79sfs"
Jul 01 18:05:40.731158 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.731115    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 01 18:05:40.746696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746664    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxw5s\" (UniqueName: \"kubernetes.io/projected/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-kube-api-access-jxw5s\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.746860 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.746860 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746740    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-cni-netd\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.746860 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-daemon-config\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.746860 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746849    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysctl-conf\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.747070 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746876    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-iptables-alerter-script\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.747070 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.746885    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:40.747070 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.746901    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-log-socket\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.747070 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.746986    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:41.246954844 +0000 UTC m=+3.358530319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:40.747275 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747121    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-cnibin\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.747275 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747137    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysctl-conf\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.747275 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747188    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.747275 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747251    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-k8s-cni-cncf-io\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747289    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-cni-multus\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747317    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvd2\" (UniqueName: \"kubernetes.io/projected/dce5b1ef-d78a-421e-b40b-fc05329403e9-kube-api-access-kkvd2\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66xc\" (UniqueName: \"kubernetes.io/projected/f629de12-6f17-47a4-bdf9-0bedd5b00327-kube-api-access-v66xc\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-tmp-dir\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747419    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-ovnkube-script-lib\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-os-release\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747452    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dce5b1ef-d78a-421e-b40b-fc05329403e9-cni-binary-copy\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747470    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747486    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25403b06-7be2-437d-ae52-105582dbf646-konnectivity-ca\") pod \"konnectivity-agent-5v7mh\" (UID: \"25403b06-7be2-437d-ae52-105582dbf646\") " pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747503    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysconfig\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-var-lib-kubelet\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.747532 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747537    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747577    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-system-cni-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-device-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747665    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-cni-bin\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747674    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-var-lib-kubelet\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747688    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-iptables-alerter-script\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-multus-certs\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747700    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysconfig\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747747    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-device-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747844    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-kubelet\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747889    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747909    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-tmp-dir\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747924    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-cni-bin\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747954    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.747983    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748010    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-cni-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-sys-fs\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748077    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-run\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748183    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-sys-fs\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748221    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zsj\" (UniqueName: \"kubernetes.io/projected/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-kube-api-access-z4zsj\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748240    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-run\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748275    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-run-netns\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41f74c25-f487-4a07-ba33-d5b5118be585-host\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748343    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-cnibin\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-hostroot\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748407    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-modprobe-d\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-host\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748473    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-systemd-units\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748522    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-var-lib-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748529    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-modprobe-d\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748549    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41f74c25-f487-4a07-ba33-d5b5118be585-serviceca\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748609    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-conf-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748611    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-host\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.748911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748658    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748726    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-socket-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748782    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-tuned\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748785    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748841    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d2f3640b-50fa-44a1-88ac-91110982cd62-dbus\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748849    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-socket-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748871    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-slash\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748900    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-ovn\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748923    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lxw\" (UniqueName: \"kubernetes.io/projected/41f74c25-f487-4a07-ba33-d5b5118be585-kube-api-access-k2lxw\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748944    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-socket-dir-parent\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748967    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-kubernetes\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.748999    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d2f3640b-50fa-44a1-88ac-91110982cd62-dbus\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-sys\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749097    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-kubernetes\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749099    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-env-overrides\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749130    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-sys\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749144    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-kubelet\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749171    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-etc-kubernetes\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.749719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749183    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749197    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25403b06-7be2-437d-ae52-105582dbf646-agent-certs\") pod \"konnectivity-agent-5v7mh\" (UID: \"25403b06-7be2-437d-ae52-105582dbf646\") " pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749256    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-lib-modules\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749284    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-tmp\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749304    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-etc-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749325    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x476\" (UniqueName: \"kubernetes.io/projected/c6130bf2-008d-4c26-b82d-7086ec17eb4d-kube-api-access-4x476\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749354    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-registration-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749377    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-lib-modules\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysctl-d\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749471    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-host-slash\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749480    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-registration-dir\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749519    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-systemd\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749554    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f629de12-6f17-47a4-bdf9-0bedd5b00327-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749528    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-host-slash\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.750517 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749564    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-netns\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749586    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-sysctl-d\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749622    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-system-cni-dir\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749651    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-systemd\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749711    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-hosts-file\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749739    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbxps\" (UniqueName: \"kubernetes.io/projected/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-kube-api-access-nbxps\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749766    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-ovnkube-config\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749792    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c7136be-3fdf-46f2-967b-f08554f849d3-ovn-node-metrics-cert\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749798    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-systemd\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749810    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-hosts-file\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749816    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5mss\" (UniqueName: \"kubernetes.io/projected/8c7136be-3fdf-46f2-967b-f08554f849d3-kube-api-access-z5mss\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749844    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbhp4\" (UniqueName: \"kubernetes.io/projected/147eec5b-b339-406f-ac6d-466934accd96-kube-api-access-bbhp4\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749875    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d2f3640b-50fa-44a1-88ac-91110982cd62-kubelet-config\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749909    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-node-log\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749932    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-os-release\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.751308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.749983    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d2f3640b-50fa-44a1-88ac-91110982cd62-kubelet-config\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:40.752952 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.752932    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-etc-tuned\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.753092 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.753000    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-tmp\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.756296 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.756275    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:05:40.756415 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.756304    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:05:40.756415 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.756337    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:40.756535 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.756417    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:41.256378446 +0000 UTC m=+3.367953920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:40.759245 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.759188    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zsj\" (UniqueName: \"kubernetes.io/projected/f38e95fd-285d-43a4-b6cf-b47d611d6ef3-kube-api-access-z4zsj\") pod \"node-resolver-cwvg4\" (UID: \"f38e95fd-285d-43a4-b6cf-b47d611d6ef3\") " pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.759245 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.759218    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66xc\" (UniqueName: \"kubernetes.io/projected/f629de12-6f17-47a4-bdf9-0bedd5b00327-kube-api-access-v66xc\") pod \"aws-ebs-csi-driver-node-tqq2l\" (UID: \"f629de12-6f17-47a4-bdf9-0bedd5b00327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.759414 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.759392    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxw5s\" (UniqueName: \"kubernetes.io/projected/4fad9a69-9911-4d32-bb4e-7186e4bd40c5-kube-api-access-jxw5s\") pod \"tuned-4xrg4\" (UID: \"4fad9a69-9911-4d32-bb4e-7186e4bd40c5\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.759945 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.759923    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbxps\" (UniqueName: \"kubernetes.io/projected/9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354-kube-api-access-nbxps\") pod \"iptables-alerter-tg99j\" (UID: \"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354\") " pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.850659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850622    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41f74c25-f487-4a07-ba33-d5b5118be585-serviceca\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.850659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850669    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-conf-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850702    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-slash\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850730    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-ovn\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lxw\" (UniqueName: \"kubernetes.io/projected/41f74c25-f487-4a07-ba33-d5b5118be585-kube-api-access-k2lxw\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850782    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-socket-dir-parent\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850784    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-conf-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850783    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-slash\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850822    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-env-overrides\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850848    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-kubelet\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850865    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-etc-kubernetes\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850867    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-socket-dir-parent\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.850901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850882    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25403b06-7be2-437d-ae52-105582dbf646-agent-certs\") pod \"konnectivity-agent-5v7mh\" (UID: \"25403b06-7be2-437d-ae52-105582dbf646\") " pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850919    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850953    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-etc-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850961    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-kubelet\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x476\" (UniqueName: \"kubernetes.io/projected/c6130bf2-008d-4c26-b82d-7086ec17eb4d-kube-api-access-4x476\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.850824    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-ovn\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851011    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851031    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-etc-kubernetes\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851043    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-systemd\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851067    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-netns\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851064    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-etc-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851092    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-system-cni-dir\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851123    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-systemd\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851134    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-netns\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851132    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-ovnkube-config\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851182    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-system-cni-dir\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851196    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c7136be-3fdf-46f2-967b-f08554f849d3-ovn-node-metrics-cert\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.851525 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5mss\" (UniqueName: \"kubernetes.io/projected/8c7136be-3fdf-46f2-967b-f08554f849d3-kube-api-access-z5mss\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851250    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbhp4\" (UniqueName: \"kubernetes.io/projected/147eec5b-b339-406f-ac6d-466934accd96-kube-api-access-bbhp4\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851268    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851277    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-node-log\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851312    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-os-release\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851320    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-node-log\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851324    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-env-overrides\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851221    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41f74c25-f487-4a07-ba33-d5b5118be585-serviceca\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851387    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-os-release\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851452    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-cni-netd\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-daemon-config\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-log-socket\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851570    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-cni-netd\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851606    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-cnibin\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851637    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851647    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-log-socket\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851665    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-k8s-cni-cncf-io\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851709    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-k8s-cni-cncf-io\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.852403 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851710    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-cni-multus\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851736    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-cnibin\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvd2\" (UniqueName: \"kubernetes.io/projected/dce5b1ef-d78a-421e-b40b-fc05329403e9-kube-api-access-kkvd2\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851749    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-cni-multus\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851759    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851792    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-ovnkube-script-lib\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851822    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-os-release\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851850    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-ovnkube-config\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851847    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dce5b1ef-d78a-421e-b40b-fc05329403e9-cni-binary-copy\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851893    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851920    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25403b06-7be2-437d-ae52-105582dbf646-konnectivity-ca\") pod \"konnectivity-agent-5v7mh\" (UID: \"25403b06-7be2-437d-ae52-105582dbf646\") " pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851956    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.851984    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-system-cni-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852059    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-os-release\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.852076    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852116    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-system-cni-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:40.852135    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:05:41.352116482 +0000 UTC m=+3.463691938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:40.853307 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-cni-bin\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852189    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-multus-certs\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852229    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-kubelet\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852256    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852277    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-cni-binary-copy\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852282    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-cni-bin\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852323    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-cni-bin\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852358    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-daemon-config\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852368    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852384    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8c7136be-3fdf-46f2-967b-f08554f849d3-ovnkube-script-lib\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852441    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-cni-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852477    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-run-netns\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852530    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-run-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852540    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-run-netns\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852622    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-var-lib-cni-bin\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.854202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41f74c25-f487-4a07-ba33-d5b5118be585-host\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852662    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-multus-cni-dir\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852664    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25403b06-7be2-437d-ae52-105582dbf646-konnectivity-ca\") pod \"konnectivity-agent-5v7mh\" (UID: \"25403b06-7be2-437d-ae52-105582dbf646\") " pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852682    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-cnibin\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852700    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-host-kubelet\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-hostroot\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852738    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-host-run-multus-certs\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852741    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/147eec5b-b339-406f-ac6d-466934accd96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852745    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-systemd-units\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852785    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-hostroot\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852796    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-var-lib-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852749    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41f74c25-f487-4a07-ba33-d5b5118be585-host\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852867    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-var-lib-openvswitch\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852890    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8c7136be-3fdf-46f2-967b-f08554f849d3-systemd-units\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.852948    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dce5b1ef-d78a-421e-b40b-fc05329403e9-cnibin\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.853079    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dce5b1ef-d78a-421e-b40b-fc05329403e9-cni-binary-copy\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.853244    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/147eec5b-b339-406f-ac6d-466934accd96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.853968    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c7136be-3fdf-46f2-967b-f08554f849d3-ovn-node-metrics-cert\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.855065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.854131    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25403b06-7be2-437d-ae52-105582dbf646-agent-certs\") pod \"konnectivity-agent-5v7mh\" (UID: \"25403b06-7be2-437d-ae52-105582dbf646\") " pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.863520 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.863491    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lxw\" (UniqueName: \"kubernetes.io/projected/41f74c25-f487-4a07-ba33-d5b5118be585-kube-api-access-k2lxw\") pod \"node-ca-dwx5g\" (UID: \"41f74c25-f487-4a07-ba33-d5b5118be585\") " pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:40.863863 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.863835    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbhp4\" (UniqueName: \"kubernetes.io/projected/147eec5b-b339-406f-ac6d-466934accd96-kube-api-access-bbhp4\") pod \"multus-additional-cni-plugins-7hj6g\" (UID: \"147eec5b-b339-406f-ac6d-466934accd96\") " pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.864094 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.864068    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x476\" (UniqueName: \"kubernetes.io/projected/c6130bf2-008d-4c26-b82d-7086ec17eb4d-kube-api-access-4x476\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:40.864302 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.864278    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvd2\" (UniqueName: \"kubernetes.io/projected/dce5b1ef-d78a-421e-b40b-fc05329403e9-kube-api-access-kkvd2\") pod \"multus-pd8v9\" (UID: \"dce5b1ef-d78a-421e-b40b-fc05329403e9\") " pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.864439 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.864419    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5mss\" (UniqueName: \"kubernetes.io/projected/8c7136be-3fdf-46f2-967b-f08554f849d3-kube-api-access-z5mss\") pod \"ovnkube-node-xrzqw\" (UID: \"8c7136be-3fdf-46f2-967b-f08554f849d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.935844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.935770    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cwvg4"
Jul 01 18:05:40.946509 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.946473    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg99j"
Jul 01 18:05:40.954887 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.954860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l"
Jul 01 18:05:40.961759 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.961734    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4xrg4"
Jul 01 18:05:40.968567 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.968545    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:05:40.976487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.976464    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pd8v9"
Jul 01 18:05:40.985048 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.985025    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:05:40.991774 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.991758    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7hj6g"
Jul 01 18:05:40.997846 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:40.997825    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dwx5g"
Jul 01 18:05:41.256971 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.256885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:41.256971 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.256944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:41.257215 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.257045    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:41.257215 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.257062    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:05:41.257215 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.257079    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:05:41.257215 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.257093    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:41.257215 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.257112    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:42.257092594 +0000 UTC m=+4.368668064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:41.257215 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.257134    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:42.257123622 +0000 UTC m=+4.368699079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:41.357373 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.357340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:41.357543 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.357509    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:41.357612 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:41.357589    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:05:42.357572406 +0000 UTC m=+4.469147858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:41.644953 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.644912    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f561e3a_b03e_4dcf_bcf6_d9c0ce8ea354.slice/crio-9a73ab125369d2fc0de39457fc07dc6f4613355ba791e15db4412ecbba8cdd35 WatchSource:0}: Error finding container 9a73ab125369d2fc0de39457fc07dc6f4613355ba791e15db4412ecbba8cdd35: Status 404 returned error can't find the container with id 9a73ab125369d2fc0de39457fc07dc6f4613355ba791e15db4412ecbba8cdd35
Jul 01 18:05:41.652148 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.651743    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fad9a69_9911_4d32_bb4e_7186e4bd40c5.slice/crio-1c2034f8448dfead16bb72fd5cedc32db6bb571a02214c05611987b282c7e1b7 WatchSource:0}: Error finding container 1c2034f8448dfead16bb72fd5cedc32db6bb571a02214c05611987b282c7e1b7: Status 404 returned error can't find the container with id 1c2034f8448dfead16bb72fd5cedc32db6bb571a02214c05611987b282c7e1b7
Jul 01 18:05:41.653210 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.653181    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7136be_3fdf_46f2_967b_f08554f849d3.slice/crio-d509991f465c43afe348bd5818959f5b0fda8dfe9e4761704a17d1b447ce10ef WatchSource:0}: Error finding container d509991f465c43afe348bd5818959f5b0fda8dfe9e4761704a17d1b447ce10ef: Status 404 returned error can't find the container with id d509991f465c43afe348bd5818959f5b0fda8dfe9e4761704a17d1b447ce10ef
Jul 01 18:05:41.656429 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.656403    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf629de12_6f17_47a4_bdf9_0bedd5b00327.slice/crio-5febead69d6465e49597f8e4aadfd3e762128709e077098b2b6f183754831407 WatchSource:0}: Error finding container 5febead69d6465e49597f8e4aadfd3e762128709e077098b2b6f183754831407: Status 404 returned error can't find the container with id 5febead69d6465e49597f8e4aadfd3e762128709e077098b2b6f183754831407
Jul 01 18:05:41.657800 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.657763    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38e95fd_285d_43a4_b6cf_b47d611d6ef3.slice/crio-4f4bf305d0fd8f26e3baef71e6999665b38b5d04971ba113220f04214eab0ff0 WatchSource:0}: Error finding container 4f4bf305d0fd8f26e3baef71e6999665b38b5d04971ba113220f04214eab0ff0: Status 404 returned error can't find the container with id 4f4bf305d0fd8f26e3baef71e6999665b38b5d04971ba113220f04214eab0ff0
Jul 01 18:05:41.658576 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.658553    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25403b06_7be2_437d_ae52_105582dbf646.slice/crio-2e623ab510ce5c68d6fc75a90b3d27a013b35427830cf2055ccf82b5b5d32891 WatchSource:0}: Error finding container 2e623ab510ce5c68d6fc75a90b3d27a013b35427830cf2055ccf82b5b5d32891: Status 404 returned error can't find the container with id 2e623ab510ce5c68d6fc75a90b3d27a013b35427830cf2055ccf82b5b5d32891
Jul 01 18:05:41.659381 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.659300    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147eec5b_b339_406f_ac6d_466934accd96.slice/crio-5858e07fb91af8bbb4ff51b5df505d98888ae3abb250ba872019191e84898910 WatchSource:0}: Error finding container 5858e07fb91af8bbb4ff51b5df505d98888ae3abb250ba872019191e84898910: Status 404 returned error can't find the container with id 5858e07fb91af8bbb4ff51b5df505d98888ae3abb250ba872019191e84898910
Jul 01 18:05:41.661145 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.661117    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce5b1ef_d78a_421e_b40b_fc05329403e9.slice/crio-3c5cc2574eaff49ddc3371e79b975809f0dc8fb91e30a8ac67ab03c32a999fcb WatchSource:0}: Error finding container 3c5cc2574eaff49ddc3371e79b975809f0dc8fb91e30a8ac67ab03c32a999fcb: Status 404 returned error can't find the container with id 3c5cc2574eaff49ddc3371e79b975809f0dc8fb91e30a8ac67ab03c32a999fcb
Jul 01 18:05:41.664096 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:05:41.664074    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f74c25_f487_4a07_ba33_d5b5118be585.slice/crio-c432d66f67e84dc550da4d5bf78ace184e959c32e18d602e1d455ebd05f13995 WatchSource:0}: Error finding container c432d66f67e84dc550da4d5bf78ace184e959c32e18d602e1d455ebd05f13995: Status 404 returned error can't find the container with id c432d66f67e84dc550da4d5bf78ace184e959c32e18d602e1d455ebd05f13995
Jul 01 18:05:41.675090 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.675058    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:00:40 +0000 UTC" deadline="2027-12-29 07:05:48.687877998 +0000 UTC"
Jul 01 18:05:41.675090 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.675088    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13093h0m7.012792993s"
Jul 01 18:05:41.708160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.708017    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5v7mh" event={"ID":"25403b06-7be2-437d-ae52-105582dbf646","Type":"ContainerStarted","Data":"2e623ab510ce5c68d6fc75a90b3d27a013b35427830cf2055ccf82b5b5d32891"}
Jul 01 18:05:41.709147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.709117    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cwvg4" event={"ID":"f38e95fd-285d-43a4-b6cf-b47d611d6ef3","Type":"ContainerStarted","Data":"4f4bf305d0fd8f26e3baef71e6999665b38b5d04971ba113220f04214eab0ff0"}
Jul 01 18:05:41.710229 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.710203    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l" event={"ID":"f629de12-6f17-47a4-bdf9-0bedd5b00327","Type":"ContainerStarted","Data":"5febead69d6465e49597f8e4aadfd3e762128709e077098b2b6f183754831407"}
Jul 01 18:05:41.711282 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.711258    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"d509991f465c43afe348bd5818959f5b0fda8dfe9e4761704a17d1b447ce10ef"}
Jul 01 18:05:41.712434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.712392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg99j" event={"ID":"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354","Type":"ContainerStarted","Data":"9a73ab125369d2fc0de39457fc07dc6f4613355ba791e15db4412ecbba8cdd35"}
Jul 01 18:05:41.713584 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.713546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dwx5g" event={"ID":"41f74c25-f487-4a07-ba33-d5b5118be585","Type":"ContainerStarted","Data":"c432d66f67e84dc550da4d5bf78ace184e959c32e18d602e1d455ebd05f13995"}
Jul 01 18:05:41.714835 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.714802    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pd8v9" event={"ID":"dce5b1ef-d78a-421e-b40b-fc05329403e9","Type":"ContainerStarted","Data":"3c5cc2574eaff49ddc3371e79b975809f0dc8fb91e30a8ac67ab03c32a999fcb"}
Jul 01 18:05:41.716084 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.716064    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerStarted","Data":"5858e07fb91af8bbb4ff51b5df505d98888ae3abb250ba872019191e84898910"}
Jul 01 18:05:41.717147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:41.717124    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4xrg4" event={"ID":"4fad9a69-9911-4d32-bb4e-7186e4bd40c5","Type":"ContainerStarted","Data":"1c2034f8448dfead16bb72fd5cedc32db6bb571a02214c05611987b282c7e1b7"}
Jul 01 18:05:42.265379 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.265279    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:42.265648 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.265624    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:42.274620 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.270389    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:42.274620 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.270489    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:44.270467097 +0000 UTC m=+6.382042567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:42.274620 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.271608    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:05:42.274620 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.271629    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:05:42.274620 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.271644    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:42.274620 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.271707    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:44.271690585 +0000 UTC m=+6.383266039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:42.366236 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.366190    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:42.366435 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.366325    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:42.366435 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.366399    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:05:44.366380198 +0000 UTC m=+6.477955654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:42.675771 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.675596    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:00:40 +0000 UTC" deadline="2027-12-07 03:10:32.067849777 +0000 UTC"
Jul 01 18:05:42.675771 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.675661    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12561h4m49.392193574s"
Jul 01 18:05:42.700026 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.699966    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:42.700208 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.700100    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:42.700559 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.700514    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:42.700669 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.700637    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:42.700735 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.700717    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:42.700874 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:42.700809    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:42.732414 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.731474    2555 generic.go:356] "Generic (PLEG): container finished" podID="663095724dbf6c956fd8fb13b67b529a" containerID="84e95d0408749435c650e080fd3087f8110cb5c31f58db9263e44c8eec078b5d" exitCode=0
Jul 01 18:05:42.732414 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.731570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal" event={"ID":"663095724dbf6c956fd8fb13b67b529a","Type":"ContainerDied","Data":"84e95d0408749435c650e080fd3087f8110cb5c31f58db9263e44c8eec078b5d"}
Jul 01 18:05:42.749884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:42.749841    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal" event={"ID":"be78b4b5448f62b72b8455220a367a2d","Type":"ContainerStarted","Data":"2be311ad26c9cf670379a78a2ffda2cdbc4668b341220328658b929e9b582279"}
Jul 01 18:05:43.770264 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:43.770189    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal" event={"ID":"663095724dbf6c956fd8fb13b67b529a","Type":"ContainerStarted","Data":"7605696680a8ab91d628856469199f40a2f49ec7abd0dd4b11ca7caa4a147a1c"}
Jul 01 18:05:43.786293 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:43.785621    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-158.ec2.internal" podStartSLOduration=3.785582538 podStartE2EDuration="3.785582538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:42.767377222 +0000 UTC m=+4.878952698" watchObservedRunningTime="2026-07-01 18:05:43.785582538 +0000 UTC m=+5.897158015"
Jul 01 18:05:43.786293 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:43.785800    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-158.ec2.internal" podStartSLOduration=3.78578924 podStartE2EDuration="3.78578924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:43.78488789 +0000 UTC m=+5.896463367" watchObservedRunningTime="2026-07-01 18:05:43.78578924 +0000 UTC m=+5.897364718"
Jul 01 18:05:44.282846 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:44.282784    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:44.283048 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:44.282872    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:44.283129 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.283048    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:44.283129 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.283118    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:48.283099827 +0000 UTC m=+10.394675299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:44.283261 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.283218    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:05:44.283261 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.283235    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:05:44.283261 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.283248    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:44.283417 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.283284    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:48.283272816 +0000 UTC m=+10.394848283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:44.383886 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:44.383841    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:44.384100 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.384083    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:44.384180 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.384154    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:05:48.384133753 +0000 UTC m=+10.495709223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:44.700419 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:44.700313    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:44.700622 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.700448    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:44.700880 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:44.700862    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:44.701023 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.700975    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:44.701023 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:44.701020    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:44.701141 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:44.701091    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:46.696964 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:46.696924    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:46.697410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:46.697081    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:46.697410 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:46.696923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:46.697410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:46.697170    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:46.697410 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:46.696924    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:46.697410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:46.697237    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:48.317086    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:48.317183    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.317238    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.317257    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.317263    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.317269    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.317317    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:56.317299178 +0000 UTC m=+18.428874627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:48.317410 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.317333    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:56.317325032 +0000 UTC m=+18.428900489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:48.419038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:48.418429    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:48.419038 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.418645    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:48.419038 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.418713    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:05:56.418694153 +0000 UTC m=+18.530269624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:48.698695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:48.697989    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:48.698695 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.698113    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:48.698695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:48.698478    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:48.698695 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.698589    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:48.698695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:48.698658    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:48.699100 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:48.698749    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:50.698633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:50.697780    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:50.698633 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:50.697908    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:50.698633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:50.698308    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:50.698633 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:50.698399    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:50.698633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:50.698461    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:50.698633 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:50.698601    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:52.697445 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:52.697385    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:52.697445 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:52.697405    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:52.697893 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:52.697385    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:52.697893 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:52.697508    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:52.697893 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:52.697582    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:52.697893 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:52.697650    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:54.697225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:54.697176    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:54.697803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:54.697176    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:54.697803 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:54.697386    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:54.697803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:54.697176    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:54.697803 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:54.697305    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:54.697803 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:54.697548    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:56.382059 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:56.382027    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:56.382081    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.382185    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.382231    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:12.382218894 +0000 UTC m=+34.493794357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.382235    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.382266    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.382282    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:56.382447 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.382344    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:12.382328669 +0000 UTC m=+34.493904143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:05:56.483387 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:56.483348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:56.483583 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.483536    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:56.483649 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.483617    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:06:12.483593219 +0000 UTC m=+34.595168674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:05:56.697455 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:56.697373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:56.697455 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:56.697394    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:56.697455 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:56.697372    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:56.697758 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.697535    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:56.697758 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.697600    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:56.697758 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:56.697692    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:05:58.698213 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:58.698183    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:05:58.698683 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:58.698280    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:05:58.698683 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:58.698356    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:05:58.698683 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:58.698438    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:05:58.698683 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:05:58.698467    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:05:58.698683 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:05:58.698576    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:00.697497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.697117    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:00.697497 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:00.697422    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:00.697497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.697148    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:00.697497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.697118    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:00.698339 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:00.697545    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:00.698339 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:00.697638    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:00.808408 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.808361    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5v7mh" event={"ID":"25403b06-7be2-437d-ae52-105582dbf646","Type":"ContainerStarted","Data":"4e71dbdd23c5ecb16fcc1e1cd3b438d4e07980116c5d55935053cbae2a81957b"}
Jul 01 18:06:00.811554 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.811502    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cwvg4" event={"ID":"f38e95fd-285d-43a4-b6cf-b47d611d6ef3","Type":"ContainerStarted","Data":"143eafc5720319ae441ba9e778cf376aa03a530fbdc507fc6391b8768e7eee1c"}
Jul 01 18:06:00.813264 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.813227    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l" event={"ID":"f629de12-6f17-47a4-bdf9-0bedd5b00327","Type":"ContainerStarted","Data":"579eaa4b00eb46f137368472637738b0fa1bbc979c2fe153ff9c5fcbb9a9d75d"}
Jul 01 18:06:00.815168 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.815150    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:06:00.815575 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.815554    2555 generic.go:356] "Generic (PLEG): container finished" podID="8c7136be-3fdf-46f2-967b-f08554f849d3" containerID="88056a023825187a11e815e27529f2a6832e8fe7516d9bf704bebf6ee302c7cf" exitCode=1
Jul 01 18:06:00.815663 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.815649    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"fce616691b1ba46b9452a563a687afd52360f33fcf824b56f5056319010835a6"}
Jul 01 18:06:00.815752 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.815722    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerDied","Data":"88056a023825187a11e815e27529f2a6832e8fe7516d9bf704bebf6ee302c7cf"}
Jul 01 18:06:00.815856 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.815783    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"755b3eea9a62d44555545b3a79d79c5a5c134a2ad1297132edcd6b1f6c370363"}
Jul 01 18:06:00.817176 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.817155    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dwx5g" event={"ID":"41f74c25-f487-4a07-ba33-d5b5118be585","Type":"ContainerStarted","Data":"720167675e2d35e123ce4bdef96d207a316554db264fa9933cc79a42b4081787"}
Jul 01 18:06:00.819105 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.819068    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pd8v9" event={"ID":"dce5b1ef-d78a-421e-b40b-fc05329403e9","Type":"ContainerStarted","Data":"c05a5a1935bef0149cf22ebbec2a8d6eeb50703c79d5e2412f04d584005a509d"}
Jul 01 18:06:00.820823 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.820797    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerStarted","Data":"9d5e576f9e569c7d458fb6424e8107827ba3dd6f8293dd2e2bf74d169056c3b8"}
Jul 01 18:06:00.822557 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.822503    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4xrg4" event={"ID":"4fad9a69-9911-4d32-bb4e-7186e4bd40c5","Type":"ContainerStarted","Data":"28b93d6f9c9abefa2cc3d878831409a03c9d321249faaa2c23897b9131f73ea0"}
Jul 01 18:06:00.823535 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.823484    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5v7mh" podStartSLOduration=7.143971008 podStartE2EDuration="21.823471956s" totalImagesPullingTime="14.679500948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:00.8233516 +0000 UTC m=+22.934927073" watchObservedRunningTime="2026-07-01 18:06:00.823471956 +0000 UTC m=+22.935047428"
Jul 01 18:06:00.854564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.854495    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cwvg4" podStartSLOduration=3.019724706 podStartE2EDuration="21.854476617s" totalImagesPullingTime="18.834751911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:00.838243632 +0000 UTC m=+22.949819105" watchObservedRunningTime="2026-07-01 18:06:00.854476617 +0000 UTC m=+22.966052090"
Jul 01 18:06:00.870357 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.870314    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pd8v9" podStartSLOduration=2.97453772 podStartE2EDuration="21.870298711s" totalImagesPullingTime="18.895760991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:00.870140043 +0000 UTC m=+22.981715515" watchObservedRunningTime="2026-07-01 18:06:00.870298711 +0000 UTC m=+22.981874183"
Jul 01 18:06:00.870590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:00.870569    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4xrg4" podStartSLOduration=3.010389593 podStartE2EDuration="21.870562653s" totalImagesPullingTime="18.86017306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:00.854401309 +0000 UTC m=+22.965976782" watchObservedRunningTime="2026-07-01 18:06:00.870562653 +0000 UTC m=+22.982138125"
Jul 01 18:06:01.012660 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.012439    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:01.090389 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.090362    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:01.825251 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.825175    2555 generic.go:356] "Generic (PLEG): container finished" podID="147eec5b-b339-406f-ac6d-466934accd96" containerID="9d5e576f9e569c7d458fb6424e8107827ba3dd6f8293dd2e2bf74d169056c3b8" exitCode=0
Jul 01 18:06:01.825983 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.825268    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerDied","Data":"9d5e576f9e569c7d458fb6424e8107827ba3dd6f8293dd2e2bf74d169056c3b8"}
Jul 01 18:06:01.828247 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.828128    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:06:01.831146 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.828927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"4ccb4f7bdcc44bbd1c8fd7e7c2f6b8f7ce958dea911fd4f50802647aa69bd192"}
Jul 01 18:06:01.831146 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.831110    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"8e87fb46dd6e96f523efdf66c79492284145a0f03951ee0f14385601e331e3ce"}
Jul 01 18:06:01.831367 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.831266    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"c3f2b777178fe7fcd9c952a6a548faaaa6cba96e6ae6f8d7a492d03855644271"}
Jul 01 18:06:01.833470 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.833426    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg99j" event={"ID":"9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354","Type":"ContainerStarted","Data":"d2ce58ff4e202aeeda1b5e85ccdd48eb254125963684331d46d508cc1342935c"}
Jul 01 18:06:01.848595 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.848547    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dwx5g" podStartSLOduration=4.015982229 podStartE2EDuration="22.848514643s" totalImagesPullingTime="18.832532414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:00.912641912 +0000 UTC m=+23.024217390" watchObservedRunningTime="2026-07-01 18:06:01.848514643 +0000 UTC m=+23.960090114"
Jul 01 18:06:01.861112 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.861059    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tg99j" podStartSLOduration=4.016091173 podStartE2EDuration="22.861040552s" totalImagesPullingTime="18.844949379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:01.86036928 +0000 UTC m=+23.971944751" watchObservedRunningTime="2026-07-01 18:06:01.861040552 +0000 UTC m=+23.972616086"
Jul 01 18:06:01.977911 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:01.977879    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:02.078722 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.078639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:02.169359 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.169335    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 01 18:06:02.697790 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.697750    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:02.698080 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.697752    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:02.698080 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.697876    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:02.698080 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:02.697878    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:02.698080 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:02.697968    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:02.698080 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:02.698041    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:02.699428 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.699338    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:06:02.169352847Z","UUID":"ec02df19-3e83-40fb-ad8b-0398c1472b59","Handler":null,"Name":"","Endpoint":""}
Jul 01 18:06:02.700974 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.700957    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 01 18:06:02.701064 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.700990    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 01 18:06:02.837808 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:02.837771    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l" event={"ID":"f629de12-6f17-47a4-bdf9-0bedd5b00327","Type":"ContainerStarted","Data":"477f95115964857d306507e2043d97a27d33df7801294ee8abd51c4847b3754c"}
Jul 01 18:06:03.706148 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:03.706108    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:03.806285 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:03.806238    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:03.843416 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:03.843388    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:06:03.843878 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:03.843794    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"ca2354a16352dce167389fa91934017ed8da3c44c6c7e9c37080eb93a707a3e3"}
Jul 01 18:06:04.697177 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:04.697139    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:04.697366 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:04.697139    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:04.697366 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:04.697271    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:04.697366 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:04.697139    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:04.697560 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:04.697371    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:04.697560 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:04.697429    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:05.307803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:05.307547    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:06:05.308243 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:05.308215    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:06:06.463118 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:06.463046    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:06.519811 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:06.519771    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:06.697805 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:06.697778    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:06.698083 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:06.697778    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:06.698083 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:06.697879    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:06.698083 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:06.697904    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:06.698083 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:06.697987    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:06.698083 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:06.698071    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:07.854283 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.854093    2555 generic.go:356] "Generic (PLEG): container finished" podID="147eec5b-b339-406f-ac6d-466934accd96" containerID="7b22e2f476f5ac6a70e0baece6676e07e2795be152605b504ca8053efe5661e6" exitCode=0
Jul 01 18:06:07.855109 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.854128    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerDied","Data":"7b22e2f476f5ac6a70e0baece6676e07e2795be152605b504ca8053efe5661e6"}
Jul 01 18:06:07.856506 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.856483    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l" event={"ID":"f629de12-6f17-47a4-bdf9-0bedd5b00327","Type":"ContainerStarted","Data":"205a2cda709c835b5e69861c6b6cf103028b5d97ca6aa253edbea0a4177dc8a1"}
Jul 01 18:06:07.859873 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.859858    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:06:07.860195 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.860170    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"15044f4dd92a78d3a5d8212f3f0a78bad6e8cfc0df3fcb0ae719479d06c91cd2"}
Jul 01 18:06:07.860375 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.860360    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:06:07.860430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.860420    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:06:07.860477 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.860450    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:06:07.860587 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.860568    2555 scope.go:117] "RemoveContainer" containerID="88056a023825187a11e815e27529f2a6832e8fe7516d9bf704bebf6ee302c7cf"
Jul 01 18:06:07.878643 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.878609    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:06:07.879764 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.879741    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:06:07.895115 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:07.895071    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqq2l" podStartSLOduration=3.875789057 podStartE2EDuration="28.895056006s" totalImagesPullingTime="25.019266949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:07.894409818 +0000 UTC m=+30.005985291" watchObservedRunningTime="2026-07-01 18:06:07.895056006 +0000 UTC m=+30.006631496"
Jul 01 18:06:08.697854 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.697825    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:08.698027 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.697917    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:08.698027 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:08.697968    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:08.698149 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.698089    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:08.698198 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:08.698172    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:08.698198 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:08.698169    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:08.700118 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.700099    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:06:08.700248 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.700165    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5v7mh"
Jul 01 18:06:08.866707 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.866680    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:06:08.867168 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.867013    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" event={"ID":"8c7136be-3fdf-46f2-967b-f08554f849d3","Type":"ContainerStarted","Data":"08c6fbe464049558e4d28bee75063a14b1177cb9eefaee3f92008c016e177f2e"}
Jul 01 18:06:08.869402 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.869377    2555 generic.go:356] "Generic (PLEG): container finished" podID="147eec5b-b339-406f-ac6d-466934accd96" containerID="03d071ada4090a91483509d7fb79c7a719fae0c5f9cf17a25e85c7fc3fab480e" exitCode=0
Jul 01 18:06:08.869542 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.869452    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerDied","Data":"03d071ada4090a91483509d7fb79c7a719fae0c5f9cf17a25e85c7fc3fab480e"}
Jul 01 18:06:08.893067 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:08.893011    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw" podStartSLOduration=10.985470257 podStartE2EDuration="29.892996663s" totalImagesPullingTime="18.907526406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:08.892365078 +0000 UTC m=+31.003940550" watchObservedRunningTime="2026-07-01 18:06:08.892996663 +0000 UTC m=+31.004572135"
Jul 01 18:06:09.350176 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.350137    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tztrj"]
Jul 01 18:06:09.350359 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.350275    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:09.350424 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:09.350386    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:09.353186 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.352926    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkpld"]
Jul 01 18:06:09.353186 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.353037    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:09.353186 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:09.353142    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:09.364112 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.364089    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45glq"]
Jul 01 18:06:09.364218 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.364208    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:09.364336 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:09.364318    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:09.873989 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.873955    2555 generic.go:356] "Generic (PLEG): container finished" podID="147eec5b-b339-406f-ac6d-466934accd96" containerID="9ec6b0776b718802e944f5389f61f704ee0a9b41630119c9f1c5eaaca9451c2a" exitCode=0
Jul 01 18:06:09.874348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:09.874036    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerDied","Data":"9ec6b0776b718802e944f5389f61f704ee0a9b41630119c9f1c5eaaca9451c2a"}
Jul 01 18:06:10.697826 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:10.697790    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:10.698012 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:10.697929    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:10.698012 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:10.697958    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:10.698139 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:10.698064    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:10.990868 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:10.990788    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:11.091482 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:11.091452    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:11.697582 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:11.697556    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:11.697741 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:11.697679    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45glq" podUID="d2f3640b-50fa-44a1-88ac-91110982cd62"
Jul 01 18:06:12.397655 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:12.397622    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:12.397670    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.397786    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.397786    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.397807    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.397820    2555 projected.go:196] Error preparing data for projected volume kube-api-access-lgprs for pod openshift-network-diagnostics/network-check-target-tztrj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.397856    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret podName:d2f3640b-50fa-44a1-88ac-91110982cd62 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:44.397837992 +0000 UTC m=+66.509413460 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret") pod "global-pull-secret-syncer-45glq" (UID: "d2f3640b-50fa-44a1-88ac-91110982cd62") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:12.398101 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.397871    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs podName:03c7c0c0-f8a0-471e-8cbc-1513d5299aa6 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:44.397864661 +0000 UTC m=+66.509440111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lgprs" (UniqueName: "kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs") pod "network-check-target-tztrj" (UID: "03c7c0c0-f8a0-471e-8cbc-1513d5299aa6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:12.498374 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:12.498335    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:12.498581 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.498457    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:12.498581 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.498537    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:06:44.498503957 +0000 UTC m=+66.610079626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:12.697581 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:12.697501    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:12.697581 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:12.697537    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:12.697770 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.697650    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:06:12.697834 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:12.697789    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tztrj" podUID="03c7c0c0-f8a0-471e-8cbc-1513d5299aa6"
Jul 01 18:06:13.199649 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.199619    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-158.ec2.internal" event="NodeReady"
Jul 01 18:06:13.199801 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.199781    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 01 18:06:13.241647 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.241617    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qdwg7"]
Jul 01 18:06:13.274601 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.274567    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6npx9"]
Jul 01 18:06:13.274769 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.274666    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.277186 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.277155    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 01 18:06:13.277341 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.277193    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 01 18:06:13.277457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.277441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x5l6c\""
Jul 01 18:06:13.283957 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.283938    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qdwg7"]
Jul 01 18:06:13.284043 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.283981    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6npx9"]
Jul 01 18:06:13.284097 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.284061    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.286415 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.286392    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 01 18:06:13.286503 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.286478    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54pz9\""
Jul 01 18:06:13.286742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.286728    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 01 18:06:13.286821 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.286731    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 01 18:06:13.354106 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.354074    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:13.404241 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.404162    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.404241 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.404200    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9wv\" (UniqueName: \"kubernetes.io/projected/da830e61-78b5-466a-9ece-ccc593a5f8f4-kube-api-access-7q9wv\") pod \"ingress-canary-6npx9\" (UID: \"da830e61-78b5-466a-9ece-ccc593a5f8f4\") " pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.404241 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.404227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8959a7b-56e5-4c96-8561-2ab4288cb369-tmp-dir\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.404876 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.404292    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da830e61-78b5-466a-9ece-ccc593a5f8f4-cert\") pod \"ingress-canary-6npx9\" (UID: \"da830e61-78b5-466a-9ece-ccc593a5f8f4\") " pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.404876 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.404485    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8959a7b-56e5-4c96-8561-2ab4288cb369-config-volume\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.404876 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.404541    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292k5\" (UniqueName: \"kubernetes.io/projected/d8959a7b-56e5-4c96-8561-2ab4288cb369-kube-api-access-292k5\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.405244 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.405210    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:13.505129 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505089    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da830e61-78b5-466a-9ece-ccc593a5f8f4-cert\") pod \"ingress-canary-6npx9\" (UID: \"da830e61-78b5-466a-9ece-ccc593a5f8f4\") " pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.505288 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505184    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8959a7b-56e5-4c96-8561-2ab4288cb369-config-volume\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.505288 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505210    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-292k5\" (UniqueName: \"kubernetes.io/projected/d8959a7b-56e5-4c96-8561-2ab4288cb369-kube-api-access-292k5\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.505288 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505240    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.505288 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505265    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9wv\" (UniqueName: \"kubernetes.io/projected/da830e61-78b5-466a-9ece-ccc593a5f8f4-kube-api-access-7q9wv\") pod \"ingress-canary-6npx9\" (UID: \"da830e61-78b5-466a-9ece-ccc593a5f8f4\") " pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.505288 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505290    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8959a7b-56e5-4c96-8561-2ab4288cb369-tmp-dir\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.505613 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505591    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8959a7b-56e5-4c96-8561-2ab4288cb369-tmp-dir\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.505780 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.505754    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8959a7b-56e5-4c96-8561-2ab4288cb369-config-volume\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.505902 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:13.505869    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:13.505978 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:13.505965    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:14.005940114 +0000 UTC m=+36.117515571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:13.510048 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.510027    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da830e61-78b5-466a-9ece-ccc593a5f8f4-cert\") pod \"ingress-canary-6npx9\" (UID: \"da830e61-78b5-466a-9ece-ccc593a5f8f4\") " pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.514456 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.514414    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-292k5\" (UniqueName: \"kubernetes.io/projected/d8959a7b-56e5-4c96-8561-2ab4288cb369-kube-api-access-292k5\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:13.514645 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.514623    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9wv\" (UniqueName: \"kubernetes.io/projected/da830e61-78b5-466a-9ece-ccc593a5f8f4-kube-api-access-7q9wv\") pod \"ingress-canary-6npx9\" (UID: \"da830e61-78b5-466a-9ece-ccc593a5f8f4\") " pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.594382 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.594344    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6npx9"
Jul 01 18:06:13.697804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.697771    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:13.700564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.700545    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 18:06:13.848566 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:13.848537    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6npx9"]
Jul 01 18:06:13.913680 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:06:13.913477    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda830e61_78b5_466a_9ece_ccc593a5f8f4.slice/crio-299cf9885f73230fe083c69a7bd263f1471fb6b1bafb3420e843f7737f283a9d WatchSource:0}: Error finding container 299cf9885f73230fe083c69a7bd263f1471fb6b1bafb3420e843f7737f283a9d: Status 404 returned error can't find the container with id 299cf9885f73230fe083c69a7bd263f1471fb6b1bafb3420e843f7737f283a9d
Jul 01 18:06:14.008766 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.008735    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:14.008882 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:14.008863    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:14.008938 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:14.008928    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:15.008913281 +0000 UTC m=+37.120488739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:14.697506 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.697468    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:14.698251 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.697722    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:14.700421 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.700386    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 18:06:14.701406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.701384    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 18:06:14.701545 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.701456    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n65jl\""
Jul 01 18:06:14.701545 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.701507    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 18:06:14.701545 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.701519    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwcg\""
Jul 01 18:06:14.889411 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.889377    2555 generic.go:356] "Generic (PLEG): container finished" podID="147eec5b-b339-406f-ac6d-466934accd96" containerID="7bae0570934069b4993a799cce909570cadaafa4de6100d3694ab984591703f7" exitCode=0
Jul 01 18:06:14.889607 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.889433    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerDied","Data":"7bae0570934069b4993a799cce909570cadaafa4de6100d3694ab984591703f7"}
Jul 01 18:06:14.890730 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:14.890693    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6npx9" event={"ID":"da830e61-78b5-466a-9ece-ccc593a5f8f4","Type":"ContainerStarted","Data":"299cf9885f73230fe083c69a7bd263f1471fb6b1bafb3420e843f7737f283a9d"}
Jul 01 18:06:15.016255 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:15.016228    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:15.016539 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:15.016509    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:15.016598 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:15.016585    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:17.016568963 +0000 UTC m=+39.128144429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:15.236366 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:15.236281    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:15.288645 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:15.288609    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:15.898350 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:15.898311    2555 generic.go:356] "Generic (PLEG): container finished" podID="147eec5b-b339-406f-ac6d-466934accd96" containerID="7b22c167ef10f5a93a6088884d58b2e1324b4294e5c9a42bd933eac2119195ac" exitCode=0
Jul 01 18:06:15.898792 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:15.898392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerDied","Data":"7b22c167ef10f5a93a6088884d58b2e1324b4294e5c9a42bd933eac2119195ac"}
Jul 01 18:06:16.902682 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:16.902644    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6npx9" event={"ID":"da830e61-78b5-466a-9ece-ccc593a5f8f4","Type":"ContainerStarted","Data":"5ee26f11acc397ed00e9a36bae76042cf42d6fdb4753d8d498419e489d4d4ee8"}
Jul 01 18:06:16.905955 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:16.905924    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" event={"ID":"147eec5b-b339-406f-ac6d-466934accd96","Type":"ContainerStarted","Data":"ecdac9587867b179e69d9d29acb1662f866e5b18bfcebfa54fe86bb365519ef2"}
Jul 01 18:06:16.918306 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:16.918246    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6npx9" podStartSLOduration=1.251424609 podStartE2EDuration="3.918226375s" totalImagesPullingTime="2.666801766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:16.918117564 +0000 UTC m=+39.029693037" watchObservedRunningTime="2026-07-01 18:06:16.918226375 +0000 UTC m=+39.029801842"
Jul 01 18:06:16.938787 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:16.938414    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7hj6g" podStartSLOduration=8.413750394000001 podStartE2EDuration="37.938396271s" totalImagesPullingTime="29.524645877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:16.937090598 +0000 UTC m=+39.048666082" watchObservedRunningTime="2026-07-01 18:06:16.938396271 +0000 UTC m=+39.049971743"
Jul 01 18:06:17.031475 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:17.031432    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:17.031788 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:17.031768    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:17.031836 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:17.031828    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:21.031812219 +0000 UTC m=+43.143387692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:17.058430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:17.058385    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:17.110751 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:17.110718    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:18.958053 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:18.958024    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:19.016732 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:19.016641    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:21.058680 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:21.058640    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:21.059065 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:21.058753    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:21.059065 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:21.058805    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:29.058790942 +0000 UTC m=+51.170366405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:27.458793 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:27.458754    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:27.521145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:27.521108    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:29.111659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:29.111610    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:29.112152 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:29.111791    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:29.112152 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:29.111878    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:45.111856622 +0000 UTC m=+67.223432089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:39.884872 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:39.884842    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrzqw"
Jul 01 18:06:40.009670 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:40.009636    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:40.067695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:40.067661    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:44.416538 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.416466    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:44.416930 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.416585    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:44.419203 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.419179    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 18:06:44.419322 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.419203    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 18:06:44.429366 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.429343    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 18:06:44.431348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.431327    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d2f3640b-50fa-44a1-88ac-91110982cd62-original-pull-secret\") pod \"global-pull-secret-syncer-45glq\" (UID: \"d2f3640b-50fa-44a1-88ac-91110982cd62\") " pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:44.439576 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.439554    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgprs\" (UniqueName: \"kubernetes.io/projected/03c7c0c0-f8a0-471e-8cbc-1513d5299aa6-kube-api-access-lgprs\") pod \"network-check-target-tztrj\" (UID: \"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6\") " pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:44.517783 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.517740    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:06:44.520231 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.520209    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 18:06:44.528234 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:44.528210    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 01 18:06:44.528350 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:44.528311    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:07:48.528287446 +0000 UTC m=+130.639862912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : secret "metrics-daemon-secret" not found
Jul 01 18:06:44.606815 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.606777    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45glq"
Jul 01 18:06:44.711804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.711776    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n65jl\""
Jul 01 18:06:44.719993 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.719963    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:44.734167 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.734139    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45glq"]
Jul 01 18:06:44.738020 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:06:44.737990    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f3640b_50fa_44a1_88ac_91110982cd62.slice/crio-6ee5865116186a6ed6a0f9c471448a52c433b205273a789029c1080103afeec8 WatchSource:0}: Error finding container 6ee5865116186a6ed6a0f9c471448a52c433b205273a789029c1080103afeec8: Status 404 returned error can't find the container with id 6ee5865116186a6ed6a0f9c471448a52c433b205273a789029c1080103afeec8
Jul 01 18:06:44.858915 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.858879    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tztrj"]
Jul 01 18:06:44.862254 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:06:44.862230    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c7c0c0_f8a0_471e_8cbc_1513d5299aa6.slice/crio-00ffd96441934b05ed680b96431c7fefde3bb5ac6e9ef525c36fc0d6dfe1f42d WatchSource:0}: Error finding container 00ffd96441934b05ed680b96431c7fefde3bb5ac6e9ef525c36fc0d6dfe1f42d: Status 404 returned error can't find the container with id 00ffd96441934b05ed680b96431c7fefde3bb5ac6e9ef525c36fc0d6dfe1f42d
Jul 01 18:06:44.972095 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.971999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tztrj" event={"ID":"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6","Type":"ContainerStarted","Data":"00ffd96441934b05ed680b96431c7fefde3bb5ac6e9ef525c36fc0d6dfe1f42d"}
Jul 01 18:06:44.973059 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:44.973034    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45glq" event={"ID":"d2f3640b-50fa-44a1-88ac-91110982cd62","Type":"ContainerStarted","Data":"6ee5865116186a6ed6a0f9c471448a52c433b205273a789029c1080103afeec8"}
Jul 01 18:06:45.121022 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:45.120979    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:06:45.121237 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:45.121120    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:06:45.121237 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:06:45.121188    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:17.121170419 +0000 UTC m=+99.232745870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:06:49.987468 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:49.987428    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tztrj" event={"ID":"03c7c0c0-f8a0-471e-8cbc-1513d5299aa6","Type":"ContainerStarted","Data":"291cb01c404d4b06aaa779d66f652c28b9d9477ea21eb1d10b0d95efaaa219cf"}
Jul 01 18:06:49.987966 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:49.987520    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:06:49.988933 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:49.988904    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45glq" event={"ID":"d2f3640b-50fa-44a1-88ac-91110982cd62","Type":"ContainerStarted","Data":"97ad94a5525f471c7ecdad8d61a2e95217bfe37673f92e81d3e1ed999238c117"}
Jul 01 18:06:50.002617 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:50.002577    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tztrj" podStartSLOduration=66.547421009 podStartE2EDuration="1m11.002561131s" totalImagesPullingTime="4.455140122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:50.001724472 +0000 UTC m=+72.113299948" watchObservedRunningTime="2026-07-01 18:06:50.002561131 +0000 UTC m=+72.114136603"
Jul 01 18:06:50.014939 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:06:50.014895    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-45glq" podStartSLOduration=66.431880634 podStartE2EDuration="1m11.014881859s" totalImagesPullingTime="4.583001225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:50.014439808 +0000 UTC m=+72.126015279" watchObservedRunningTime="2026-07-01 18:06:50.014881859 +0000 UTC m=+72.126457330"
Jul 01 18:07:17.135984 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:07:17.135929    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:07:17.136477 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:07:17.136088    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:17.136477 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:07:17.136159    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:08:21.13614352 +0000 UTC m=+163.247718996 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:20.993395 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:07:20.993364    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tztrj"
Jul 01 18:07:48.541818 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:07:48.541778    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:07:48.542308 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:07:48.541944    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 01 18:07:48.542308 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:07:48.542020    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs podName:c6130bf2-008d-4c26-b82d-7086ec17eb4d nodeName:}" failed. No retries permitted until 2026-07-01 18:09:50.542003729 +0000 UTC m=+252.653579195 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs") pod "network-metrics-daemon-gkpld" (UID: "c6130bf2-008d-4c26-b82d-7086ec17eb4d") : secret "metrics-daemon-secret" not found
Jul 01 18:08:16.286499 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:08:16.286454    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qdwg7" podUID="d8959a7b-56e5-4c96-8561-2ab4288cb369"
Jul 01 18:08:17.191902 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:08:17.191868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:08:17.714933 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:08:17.714879    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gkpld" podUID="c6130bf2-008d-4c26-b82d-7086ec17eb4d"
Jul 01 18:08:21.164801 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:08:21.164757    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:08:21.165275 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:08:21.164884    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:08:21.165275 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:08:21.164954    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls podName:d8959a7b-56e5-4c96-8561-2ab4288cb369 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:23.164937936 +0000 UTC m=+285.276513405 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls") pod "dns-default-qdwg7" (UID: "d8959a7b-56e5-4c96-8561-2ab4288cb369") : secret "dns-default-metrics-tls" not found
Jul 01 18:08:28.697793 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:08:28.697754    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:09:00.105205 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:00.105132    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:25.798540 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.798472    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-s8mwl"]
Jul 01 18:09:25.800273 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.800258    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.803004 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.802908    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 01 18:09:25.803661 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.803640    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 01 18:09:25.803661 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.803660    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cgdl9\""
Jul 01 18:09:25.803814 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.803725    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 01 18:09:25.803814 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.803727    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 01 18:09:25.803916 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.803900    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7654b5cf6f-flhh8"]
Jul 01 18:09:25.805655 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.805640    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.808003 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.807985    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 01 18:09:25.808088 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.808070    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rc2wq\""
Jul 01 18:09:25.808469 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.808453    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 01 18:09:25.808700 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.808677    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 01 18:09:25.811714 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.811693    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 01 18:09:25.815000 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.814979    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 01 18:09:25.816707 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.816687    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-s8mwl"]
Jul 01 18:09:25.823888 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.823870    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7654b5cf6f-flhh8"]
Jul 01 18:09:25.889247 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.889218    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"]
Jul 01 18:09:25.890997 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.890982    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"
Jul 01 18:09:25.892806 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.892768    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"]
Jul 01 18:09:25.893452 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.893434    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6wlmb\""
Jul 01 18:09:25.894422 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.894405    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"]
Jul 01 18:09:25.894512 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.894497    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:25.896150 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.896133    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"]
Jul 01 18:09:25.896300 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.896281    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:25.896844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.896824    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 01 18:09:25.897166 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.897146    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 01 18:09:25.897263 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.897190    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 01 18:09:25.897263 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.897190    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:09:25.897263 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.897242    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9s94g\""
Jul 01 18:09:25.897980 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.897964    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:25.898612 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.898584    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 01 18:09:25.898819 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.898800    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 01 18:09:25.898819 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.898811    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rzqs5\""
Jul 01 18:09:25.900599 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.900584    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 01 18:09:25.900692 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.900618    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 01 18:09:25.905148 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.902065    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 01 18:09:25.905148 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.902250    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rrzqj\""
Jul 01 18:09:25.905148 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.902945    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 01 18:09:25.907267 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.907243    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nk5v\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-kube-api-access-6nk5v\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.907453 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.907434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-image-registry-private-configuration\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.907617 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.907599    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-trusted-ca\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.907753 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.907709    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"]
Jul 01 18:09:25.908000 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.907709    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-installation-pull-secrets\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.908094 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908022    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1ebe241-4196-4ecf-899b-4680e42bde79-tmp\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.908094 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908055    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-bound-sa-token\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.908094 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908081    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-certificates\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.908252 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908103    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e1ebe241-4196-4ecf-899b-4680e42bde79-snapshots\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.908252 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908180    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5960b9b-c236-447e-b8cd-3edba7ca3b74-ca-trust-extracted\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.908252 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908218    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1ebe241-4196-4ecf-899b-4680e42bde79-serving-cert\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.908501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908281    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ebe241-4196-4ecf-899b-4680e42bde79-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.908501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908318    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ebe241-4196-4ecf-899b-4680e42bde79-service-ca-bundle\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.908501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908341    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wh2d\" (UniqueName: \"kubernetes.io/projected/e1ebe241-4196-4ecf-899b-4680e42bde79-kube-api-access-7wh2d\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:25.908501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908370    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:25.908858 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.908840    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"]
Jul 01 18:09:25.909720 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.909700    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"]
Jul 01 18:09:25.913267 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.913243    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"]
Jul 01 18:09:25.988571 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.988538    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"]
Jul 01 18:09:25.990497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.990480    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"
Jul 01 18:09:25.992973 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.992953    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:09:25.993045 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.992976    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 01 18:09:25.993045 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:25.993009    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nkdnm\""
Jul 01 18:09:26.000631 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.000607    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"]
Jul 01 18:09:26.009046 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009023    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq65z\" (UniqueName: \"kubernetes.io/projected/acc0c7d0-71a9-4348-8840-1d1c3b94483e-kube-api-access-gq65z\") pod \"network-check-source-56499946bc-c9pdm\" (UID: \"acc0c7d0-71a9-4348-8840-1d1c3b94483e\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"
Jul 01 18:09:26.009140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009056    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.009140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009084    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nkdw\" (UniqueName: \"kubernetes.io/projected/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-kube-api-access-8nkdw\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.009272 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009142    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.009272 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009183    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1ebe241-4196-4ecf-899b-4680e42bde79-tmp\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.009272 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009217    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-installation-pull-secrets\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.009272 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.009237    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:09:26.009272 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.009252    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7654b5cf6f-flhh8: secret "image-registry-tls" not found
Jul 01 18:09:26.009272 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009264    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef0201e-2031-49b3-a2ad-49424aa639ac-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009294    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-bound-sa-token\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.009313    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls podName:d5960b9b-c236-447e-b8cd-3edba7ca3b74 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:26.509294431 +0000 UTC m=+228.620869893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls") pod "image-registry-7654b5cf6f-flhh8" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74") : secret "image-registry-tls" not found
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wh2d\" (UniqueName: \"kubernetes.io/projected/e1ebe241-4196-4ecf-899b-4680e42bde79-kube-api-access-7wh2d\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009368    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e1ebe241-4196-4ecf-899b-4680e42bde79-snapshots\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5960b9b-c236-447e-b8cd-3edba7ca3b74-ca-trust-extracted\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ebe241-4196-4ecf-899b-4680e42bde79-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009454    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e96b874c-e65c-4181-b59e-594a1d25a5b9-config\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009471    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glv6n\" (UniqueName: \"kubernetes.io/projected/e96b874c-e65c-4181-b59e-594a1d25a5b9-kube-api-access-glv6n\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009519    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e96b874c-e65c-4181-b59e-594a1d25a5b9-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009563    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1ebe241-4196-4ecf-899b-4680e42bde79-tmp\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.009585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009576    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ebe241-4196-4ecf-899b-4680e42bde79-service-ca-bundle\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009613    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nk5v\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-kube-api-access-6nk5v\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009731    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-trusted-ca\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009776    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-image-registry-private-configuration\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009813    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009826    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5960b9b-c236-447e-b8cd-3edba7ca3b74-ca-trust-extracted\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009856    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-certificates\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009883    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.009924    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1ebe241-4196-4ecf-899b-4680e42bde79-serving-cert\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.010103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.010020    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e1ebe241-4196-4ecf-899b-4680e42bde79-snapshots\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.010567 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.010173    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ebe241-4196-4ecf-899b-4680e42bde79-service-ca-bundle\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.010567 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.010367    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ebe241-4196-4ecf-899b-4680e42bde79-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.010740 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.010686    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-certificates\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.010740 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.010731    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-trusted-ca\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.012202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.012174    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-installation-pull-secrets\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.012342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.012321    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-image-registry-private-configuration\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.012589 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.012574    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1ebe241-4196-4ecf-899b-4680e42bde79-serving-cert\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.018336 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.018317    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wh2d\" (UniqueName: \"kubernetes.io/projected/e1ebe241-4196-4ecf-899b-4680e42bde79-kube-api-access-7wh2d\") pod \"insights-operator-5f67b55555-s8mwl\" (UID: \"e1ebe241-4196-4ecf-899b-4680e42bde79\") " pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.018534 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.018507    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-bound-sa-token\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.019232 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.019214    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nk5v\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-kube-api-access-6nk5v\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.041384 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.041359    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:26.110179 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.110098    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-s8mwl"
Jul 01 18:09:26.111326 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glv6n\" (UniqueName: \"kubernetes.io/projected/e96b874c-e65c-4181-b59e-594a1d25a5b9-kube-api-access-glv6n\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.111326 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111324    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e96b874c-e65c-4181-b59e-594a1d25a5b9-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.111552 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.111552 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111470    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:26.111652 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111558    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq65z\" (UniqueName: \"kubernetes.io/projected/acc0c7d0-71a9-4348-8840-1d1c3b94483e-kube-api-access-gq65z\") pod \"network-check-source-56499946bc-c9pdm\" (UID: \"acc0c7d0-71a9-4348-8840-1d1c3b94483e\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"
Jul 01 18:09:26.111652 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111588    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.111652 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.111605    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 01 18:09:26.111652 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111612    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nkdw\" (UniqueName: \"kubernetes.io/projected/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-kube-api-access-8nkdw\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.111839 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.111677    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert podName:4ef0201e-2031-49b3-a2ad-49424aa639ac nodeName:}" failed. No retries permitted until 2026-07-01 18:09:26.611657537 +0000 UTC m=+228.723232995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-rqflz" (UID: "4ef0201e-2031-49b3-a2ad-49424aa639ac") : secret "networking-console-plugin-cert" not found
Jul 01 18:09:26.111839 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef0201e-2031-49b3-a2ad-49424aa639ac-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:26.111839 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.111719    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:26.111839 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111746    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsf7s\" (UniqueName: \"kubernetes.io/projected/47db5141-3d57-4582-a386-c7f18064e5b4-kube-api-access-hsf7s\") pod \"volume-data-source-validator-69d9f679db-bhs6v\" (UID: \"47db5141-3d57-4582-a386-c7f18064e5b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"
Jul 01 18:09:26.111839 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.111795    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls podName:74f37af7-55d5-4a5d-ba56-3a9c475e6f9f nodeName:}" failed. No retries permitted until 2026-07-01 18:09:26.611777553 +0000 UTC m=+228.723353004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-xdj5w" (UID: "74f37af7-55d5-4a5d-ba56-3a9c475e6f9f") : secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:26.111839 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.111835    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e96b874c-e65c-4181-b59e-594a1d25a5b9-config\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.112198 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.112175    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.112353 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.112333    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ef0201e-2031-49b3-a2ad-49424aa639ac-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:26.112424 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.112389    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e96b874c-e65c-4181-b59e-594a1d25a5b9-config\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.114021 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.114003    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e96b874c-e65c-4181-b59e-594a1d25a5b9-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.121617 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.121594    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nkdw\" (UniqueName: \"kubernetes.io/projected/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-kube-api-access-8nkdw\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.121703 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.121661    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glv6n\" (UniqueName: \"kubernetes.io/projected/e96b874c-e65c-4181-b59e-594a1d25a5b9-kube-api-access-glv6n\") pod \"service-ca-operator-5d7b7dc95c-pvb9b\" (UID: \"e96b874c-e65c-4181-b59e-594a1d25a5b9\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.122159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.122144    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq65z\" (UniqueName: \"kubernetes.io/projected/acc0c7d0-71a9-4348-8840-1d1c3b94483e-kube-api-access-gq65z\") pod \"network-check-source-56499946bc-c9pdm\" (UID: \"acc0c7d0-71a9-4348-8840-1d1c3b94483e\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"
Jul 01 18:09:26.201959 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.201929    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"
Jul 01 18:09:26.212843 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.212816    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"
Jul 01 18:09:26.213076 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.213052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsf7s\" (UniqueName: \"kubernetes.io/projected/47db5141-3d57-4582-a386-c7f18064e5b4-kube-api-access-hsf7s\") pod \"volume-data-source-validator-69d9f679db-bhs6v\" (UID: \"47db5141-3d57-4582-a386-c7f18064e5b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"
Jul 01 18:09:26.221991 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.221967    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsf7s\" (UniqueName: \"kubernetes.io/projected/47db5141-3d57-4582-a386-c7f18064e5b4-kube-api-access-hsf7s\") pod \"volume-data-source-validator-69d9f679db-bhs6v\" (UID: \"47db5141-3d57-4582-a386-c7f18064e5b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"
Jul 01 18:09:26.233779 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.233751    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-s8mwl"]
Jul 01 18:09:26.236683 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:26.236654    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ebe241_4196_4ecf_899b_4680e42bde79.slice/crio-9023a8a28abf46d186645799daaa24a68d57fd2adda430b0e31837db01a4aa38 WatchSource:0}: Error finding container 9023a8a28abf46d186645799daaa24a68d57fd2adda430b0e31837db01a4aa38: Status 404 returned error can't find the container with id 9023a8a28abf46d186645799daaa24a68d57fd2adda430b0e31837db01a4aa38
Jul 01 18:09:26.299937 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.299911    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"
Jul 01 18:09:26.330920 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.330769    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-c9pdm"]
Jul 01 18:09:26.332904 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:26.332880    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc0c7d0_71a9_4348_8840_1d1c3b94483e.slice/crio-4fdcbf3e95ac589b2a4c50194878e037eec8c3edf2b4d3e5927c3bf77a4d62b7 WatchSource:0}: Error finding container 4fdcbf3e95ac589b2a4c50194878e037eec8c3edf2b4d3e5927c3bf77a4d62b7: Status 404 returned error can't find the container with id 4fdcbf3e95ac589b2a4c50194878e037eec8c3edf2b4d3e5927c3bf77a4d62b7
Jul 01 18:09:26.351864 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.351829    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b"]
Jul 01 18:09:26.353373 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.353232    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm" event={"ID":"acc0c7d0-71a9-4348-8840-1d1c3b94483e","Type":"ContainerStarted","Data":"4fdcbf3e95ac589b2a4c50194878e037eec8c3edf2b4d3e5927c3bf77a4d62b7"}
Jul 01 18:09:26.354664 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.354602    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-s8mwl" event={"ID":"e1ebe241-4196-4ecf-899b-4680e42bde79","Type":"ContainerStarted","Data":"9023a8a28abf46d186645799daaa24a68d57fd2adda430b0e31837db01a4aa38"}
Jul 01 18:09:26.359726 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:26.359338    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96b874c_e65c_4181_b59e_594a1d25a5b9.slice/crio-5d33ca25d5425ef8b3ce8704278ad8de8e852df4ad68d86c1f885fe90878966a WatchSource:0}: Error finding container 5d33ca25d5425ef8b3ce8704278ad8de8e852df4ad68d86c1f885fe90878966a: Status 404 returned error can't find the container with id 5d33ca25d5425ef8b3ce8704278ad8de8e852df4ad68d86c1f885fe90878966a
Jul 01 18:09:26.436149 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.436118    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v"]
Jul 01 18:09:26.439169 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:26.439142    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47db5141_3d57_4582_a386_c7f18064e5b4.slice/crio-591795816a25e440584a885e77b6067e6eb844cfe9b4c1a1a6989bc5182f32bb WatchSource:0}: Error finding container 591795816a25e440584a885e77b6067e6eb844cfe9b4c1a1a6989bc5182f32bb: Status 404 returned error can't find the container with id 591795816a25e440584a885e77b6067e6eb844cfe9b4c1a1a6989bc5182f32bb
Jul 01 18:09:26.460873 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.460845    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:26.516247 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.516214    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:26.516371 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.516338    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:09:26.516371 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.516351    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7654b5cf6f-flhh8: secret "image-registry-tls" not found
Jul 01 18:09:26.516433 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.516401    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls podName:d5960b9b-c236-447e-b8cd-3edba7ca3b74 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:27.516386172 +0000 UTC m=+229.627961623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls") pod "image-registry-7654b5cf6f-flhh8" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74") : secret "image-registry-tls" not found
Jul 01 18:09:26.616918 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.616826    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:26.617082 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:26.616923    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:26.617082 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.616972    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:26.617082 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.617010    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 01 18:09:26.617082 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.617034    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls podName:74f37af7-55d5-4a5d-ba56-3a9c475e6f9f nodeName:}" failed. No retries permitted until 2026-07-01 18:09:27.617019316 +0000 UTC m=+229.728594769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-xdj5w" (UID: "74f37af7-55d5-4a5d-ba56-3a9c475e6f9f") : secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:26.617082 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:26.617054    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert podName:4ef0201e-2031-49b3-a2ad-49424aa639ac nodeName:}" failed. No retries permitted until 2026-07-01 18:09:27.61704235 +0000 UTC m=+229.728617800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-rqflz" (UID: "4ef0201e-2031-49b3-a2ad-49424aa639ac") : secret "networking-console-plugin-cert" not found
Jul 01 18:09:27.358672 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.358635    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm" event={"ID":"acc0c7d0-71a9-4348-8840-1d1c3b94483e","Type":"ContainerStarted","Data":"c8fbfd682e288a13b669af2694fdd08f48a67bd174c92e369386e9c49180b285"}
Jul 01 18:09:27.359778 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.359753    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v" event={"ID":"47db5141-3d57-4582-a386-c7f18064e5b4","Type":"ContainerStarted","Data":"591795816a25e440584a885e77b6067e6eb844cfe9b4c1a1a6989bc5182f32bb"}
Jul 01 18:09:27.360728 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.360709    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b" event={"ID":"e96b874c-e65c-4181-b59e-594a1d25a5b9","Type":"ContainerStarted","Data":"5d33ca25d5425ef8b3ce8704278ad8de8e852df4ad68d86c1f885fe90878966a"}
Jul 01 18:09:27.373446 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.373402    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-c9pdm" podStartSLOduration=2.373389686 podStartE2EDuration="2.373389686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:27.372628901 +0000 UTC m=+229.484204417" watchObservedRunningTime="2026-07-01 18:09:27.373389686 +0000 UTC m=+229.484965158"
Jul 01 18:09:27.524731 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.524693    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:27.524914 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.524858    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:09:27.524914 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.524881    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7654b5cf6f-flhh8: secret "image-registry-tls" not found
Jul 01 18:09:27.525025 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.524952    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls podName:d5960b9b-c236-447e-b8cd-3edba7ca3b74 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:29.524929417 +0000 UTC m=+231.636504885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls") pod "image-registry-7654b5cf6f-flhh8" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74") : secret "image-registry-tls" not found
Jul 01 18:09:27.626107 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.626015    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:27.626107 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:27.626080    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:27.626311 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.626193    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:27.626311 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.626269    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls podName:74f37af7-55d5-4a5d-ba56-3a9c475e6f9f nodeName:}" failed. No retries permitted until 2026-07-01 18:09:29.626249644 +0000 UTC m=+231.737825099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-xdj5w" (UID: "74f37af7-55d5-4a5d-ba56-3a9c475e6f9f") : secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:27.626311 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.626193    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 01 18:09:27.626443 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:27.626340    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert podName:4ef0201e-2031-49b3-a2ad-49424aa639ac nodeName:}" failed. No retries permitted until 2026-07-01 18:09:29.626326777 +0000 UTC m=+231.737902227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-rqflz" (UID: "4ef0201e-2031-49b3-a2ad-49424aa639ac") : secret "networking-console-plugin-cert" not found
Jul 01 18:09:28.368787 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:28.368745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v" event={"ID":"47db5141-3d57-4582-a386-c7f18064e5b4","Type":"ContainerStarted","Data":"de28902cdcf3023810f39690aa7f86e940acfde16b8fba95452c50f40652aa1a"}
Jul 01 18:09:28.384615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:28.384555    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-bhs6v" podStartSLOduration=1.673117309 podStartE2EDuration="3.384515757s" totalImagesPullingTime="1.711398448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:28.383188333 +0000 UTC m=+230.494763803" watchObservedRunningTime="2026-07-01 18:09:28.384515757 +0000 UTC m=+230.496091231"
Jul 01 18:09:28.460951 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:28.460860    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:28.519652 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:28.519615    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:28.859127 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:28.859093    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:28.908506 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:28.908468    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:29.544836 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:29.544736    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:29.545260 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.544880    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:09:29.545260 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.544903    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7654b5cf6f-flhh8: secret "image-registry-tls" not found
Jul 01 18:09:29.545260 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.544973    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls podName:d5960b9b-c236-447e-b8cd-3edba7ca3b74 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:33.544953366 +0000 UTC m=+235.656528820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls") pod "image-registry-7654b5cf6f-flhh8" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74") : secret "image-registry-tls" not found
Jul 01 18:09:29.645341 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:29.645310    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:29.645452 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:29.645424    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:29.645513 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.645475    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:29.645596 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.645519    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 01 18:09:29.645596 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.645566    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls podName:74f37af7-55d5-4a5d-ba56-3a9c475e6f9f nodeName:}" failed. No retries permitted until 2026-07-01 18:09:33.645544091 +0000 UTC m=+235.757119568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-xdj5w" (UID: "74f37af7-55d5-4a5d-ba56-3a9c475e6f9f") : secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:29.645596 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:29.645587    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert podName:4ef0201e-2031-49b3-a2ad-49424aa639ac nodeName:}" failed. No retries permitted until 2026-07-01 18:09:33.645576531 +0000 UTC m=+235.757151988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-rqflz" (UID: "4ef0201e-2031-49b3-a2ad-49424aa639ac") : secret "networking-console-plugin-cert" not found
Jul 01 18:09:30.376893 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:30.376859    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b" event={"ID":"e96b874c-e65c-4181-b59e-594a1d25a5b9","Type":"ContainerStarted","Data":"7595d150c0a331bc6bbd24e41058d65ef8903b2ef4f8f0f7e903572061f36898"}
Jul 01 18:09:30.378354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:30.378327    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-s8mwl" event={"ID":"e1ebe241-4196-4ecf-899b-4680e42bde79","Type":"ContainerStarted","Data":"fbcaa7112b19c263898e4c69842db952d59092494421ff82ec284323c3fc667c"}
Jul 01 18:09:30.394237 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:30.394189    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b" podStartSLOduration=2.116742695 podStartE2EDuration="5.394173085s" totalImagesPullingTime="3.27743039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:30.393672275 +0000 UTC m=+232.505247773" watchObservedRunningTime="2026-07-01 18:09:30.394173085 +0000 UTC m=+232.505748557"
Jul 01 18:09:30.413424 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:30.413366    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-s8mwl" podStartSLOduration=2.009994817 podStartE2EDuration="5.413341954s" totalImagesPullingTime="3.403347137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:30.411977643 +0000 UTC m=+232.523553116" watchObservedRunningTime="2026-07-01 18:09:30.413341954 +0000 UTC m=+232.524917427"
Jul 01 18:09:31.053711 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.053676    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:31.125330 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.125297    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lfktk"]
Jul 01 18:09:31.128353 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.128332    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.131083 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.131058    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 01 18:09:31.131247 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.131225    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kr6bt\""
Jul 01 18:09:31.132019 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.132001    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 01 18:09:31.155422 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.155395    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lfktk"]
Jul 01 18:09:31.158506 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.158481    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6bd40db-b821-4a92-8e59-5e4793a04400-data-volume\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.158630 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.158558    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6bd40db-b821-4a92-8e59-5e4793a04400-crio-socket\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.158630 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.158625    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.158717 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.158678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8htv\" (UniqueName: \"kubernetes.io/projected/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-api-access-v8htv\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.158767 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.158720    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.161506 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.161475    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:31.227617 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.227586    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:31.259798 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.259769    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8htv\" (UniqueName: \"kubernetes.io/projected/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-api-access-v8htv\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.259925 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.259809    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.259925 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.259883    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6bd40db-b821-4a92-8e59-5e4793a04400-data-volume\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.260019 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.259930    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6bd40db-b821-4a92-8e59-5e4793a04400-crio-socket\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.260019 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.259964    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:09:31.260019 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.259965    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.260160 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.260029    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:31.760009707 +0000 UTC m=+233.871585157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : configmap "kube-rbac-proxy" not found
Jul 01 18:09:31.260160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.260081    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6bd40db-b821-4a92-8e59-5e4793a04400-crio-socket\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.260160 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.260028    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:31.260160 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.260143    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:31.760130296 +0000 UTC m=+233.871705747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:31.260368 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.260333    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6bd40db-b821-4a92-8e59-5e4793a04400-data-volume\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.274448 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.274424    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8htv\" (UniqueName: \"kubernetes.io/projected/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-api-access-v8htv\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.541980 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.541948    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:31.764324 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.764289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.764488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.764351    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:31.764488 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.764445    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:31.764488 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.764450    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:09:31.764660 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.764511    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:32.76449678 +0000 UTC m=+234.876072233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:31.764660 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:31.764553    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:32.764520349 +0000 UTC m=+234.876095799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : configmap "kube-rbac-proxy" not found
Jul 01 18:09:31.805356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:31.805291    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:32.771688 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:32.771658    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:32.772068 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:32.771711    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:32.772068 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:32.771812    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:09:32.772068 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:32.771859    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:34.771846332 +0000 UTC m=+236.883421782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : configmap "kube-rbac-proxy" not found
Jul 01 18:09:32.772068 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:32.771812    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:32.772068 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:32.771939    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:34.771926471 +0000 UTC m=+236.883501921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:33.143777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.143743    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"]
Jul 01 18:09:33.146933 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.146914    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.149418 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.149397    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 01 18:09:33.150363 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.150337    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 01 18:09:33.150465 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.150368    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 01 18:09:33.150465 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.150399    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hzq2z\""
Jul 01 18:09:33.150465 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.150427    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 01 18:09:33.154596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.154570    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"]
Jul 01 18:09:33.176605 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.176575    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de2dd327-1f33-41b1-9da7-daf22c4bab40-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.176776 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.176641    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de2dd327-1f33-41b1-9da7-daf22c4bab40-signing-key\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.176776 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.176686    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrxk\" (UniqueName: \"kubernetes.io/projected/de2dd327-1f33-41b1-9da7-daf22c4bab40-kube-api-access-wtrxk\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.184894 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.184870    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:33.245932 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.245902    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:33.277177 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.277146    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de2dd327-1f33-41b1-9da7-daf22c4bab40-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.277293 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.277207    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de2dd327-1f33-41b1-9da7-daf22c4bab40-signing-key\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.277293 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.277233    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrxk\" (UniqueName: \"kubernetes.io/projected/de2dd327-1f33-41b1-9da7-daf22c4bab40-kube-api-access-wtrxk\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.277835 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.277814    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de2dd327-1f33-41b1-9da7-daf22c4bab40-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.279651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.279631    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de2dd327-1f33-41b1-9da7-daf22c4bab40-signing-key\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.286337 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.286312    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrxk\" (UniqueName: \"kubernetes.io/projected/de2dd327-1f33-41b1-9da7-daf22c4bab40-kube-api-access-wtrxk\") pod \"service-ca-7bb4f4bcc7-dlc4n\" (UID: \"de2dd327-1f33-41b1-9da7-daf22c4bab40\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.456990 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.456902    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"
Jul 01 18:09:33.578993 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.578964    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:33.579210 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.579047    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n"]
Jul 01 18:09:33.579210 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.579103    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:09:33.579210 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.579117    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7654b5cf6f-flhh8: secret "image-registry-tls" not found
Jul 01 18:09:33.579210 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.579169    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls podName:d5960b9b-c236-447e-b8cd-3edba7ca3b74 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:41.579153524 +0000 UTC m=+243.690728974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls") pod "image-registry-7654b5cf6f-flhh8" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74") : secret "image-registry-tls" not found
Jul 01 18:09:33.581656 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:33.581627    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2dd327_1f33_41b1_9da7_daf22c4bab40.slice/crio-808040f30192b8ab88f87456e0e51834107667efe01725567821fba031a62553 WatchSource:0}: Error finding container 808040f30192b8ab88f87456e0e51834107667efe01725567821fba031a62553: Status 404 returned error can't find the container with id 808040f30192b8ab88f87456e0e51834107667efe01725567821fba031a62553
Jul 01 18:09:33.679836 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.679800    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:33.680024 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.679866    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:33.680024 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.679978    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:33.680136 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.680035    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls podName:74f37af7-55d5-4a5d-ba56-3a9c475e6f9f nodeName:}" failed. No retries permitted until 2026-07-01 18:09:41.680016884 +0000 UTC m=+243.791592334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-xdj5w" (UID: "74f37af7-55d5-4a5d-ba56-3a9c475e6f9f") : secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:33.680136 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.679978    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 01 18:09:33.680136 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:33.680125    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert podName:4ef0201e-2031-49b3-a2ad-49424aa639ac nodeName:}" failed. No retries permitted until 2026-07-01 18:09:41.680106869 +0000 UTC m=+243.791682339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-rqflz" (UID: "4ef0201e-2031-49b3-a2ad-49424aa639ac") : secret "networking-console-plugin-cert" not found
Jul 01 18:09:33.901860 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:33.901825    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cwvg4_f38e95fd-285d-43a4-b6cf-b47d611d6ef3/dns-node-resolver/0.log"
Jul 01 18:09:34.083284 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.083251    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:34.184490 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.184406    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:34.391326 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.391292    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n" event={"ID":"de2dd327-1f33-41b1-9da7-daf22c4bab40","Type":"ContainerStarted","Data":"f2506e532874b9d1bbebefd4d102f44ad42e947b21c62489b3da32ef97e141b4"}
Jul 01 18:09:34.391546 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.391338    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n" event={"ID":"de2dd327-1f33-41b1-9da7-daf22c4bab40","Type":"ContainerStarted","Data":"808040f30192b8ab88f87456e0e51834107667efe01725567821fba031a62553"}
Jul 01 18:09:34.407815 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.407764    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-dlc4n" podStartSLOduration=1.407746965 podStartE2EDuration="1.407746965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:34.406999212 +0000 UTC m=+236.518574685" watchObservedRunningTime="2026-07-01 18:09:34.407746965 +0000 UTC m=+236.519322437"
Jul 01 18:09:34.701258 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.701233    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dwx5g_41f74c25-f487-4a07-ba33-d5b5118be585/node-ca/0.log"
Jul 01 18:09:34.788833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.788791    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:34.789032 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.788854    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:34.789032 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:34.788943    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:34.789032 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:34.788950    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:09:34.789032 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:34.789012    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:38.788996503 +0000 UTC m=+240.900571963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:34.789032 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:34.789027    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:38.789021598 +0000 UTC m=+240.900597048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : configmap "kube-rbac-proxy" not found
Jul 01 18:09:34.864445 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:34.864411    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:35.238709 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:35.238665    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:35.382142 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:35.382111    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:35.481714 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:35.481679    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:35.502322 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:35.502246    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6npx9_da830e61-78b5-466a-9ece-ccc593a5f8f4/serve-healthcheck-canary/0.log"
Jul 01 18:09:35.582271 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:35.582236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:35.931831 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:35.931802    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:36.731562 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:36.731509    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:37.610575 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:37.610519    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:37.662106 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:37.662077    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:37.757357 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:37.757324    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:38.165883 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:38.165853    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:38.824861 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:38.824809    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:38.825358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:38.824889    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:38.825358 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:38.824997    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:09:38.825358 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:38.825030    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:38.825358 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:38.825059    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:46.825044284 +0000 UTC m=+248.936619734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : configmap "kube-rbac-proxy" not found
Jul 01 18:09:38.825358 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:38.825088    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls podName:c6bd40db-b821-4a92-8e59-5e4793a04400 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:46.825070608 +0000 UTC m=+248.936646078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lfktk" (UID: "c6bd40db-b821-4a92-8e59-5e4793a04400") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:09:38.938670 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:38.938643    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:38.996043 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:38.996003    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:39.131250 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:39.131164    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:39.188982 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:39.188944    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:39.536997 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:39.536972    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:39.735175 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:39.735139    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:40.338694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:40.338656    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:41.475359 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.475324    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:41.576624 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.576593    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:41.647060 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.647028    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:41.649361 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.649333    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"image-registry-7654b5cf6f-flhh8\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") " pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:41.718469 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.718441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rc2wq\""
Jul 01 18:09:41.726504 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.726452    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:41.735738 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.735710    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:41.747898 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.747870    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:41.748022 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.747936    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:41.748079 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:41.748022    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 01 18:09:41.748125 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:41.748102    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert podName:4ef0201e-2031-49b3-a2ad-49424aa639ac nodeName:}" failed. No retries permitted until 2026-07-01 18:09:57.748082409 +0000 UTC m=+259.859657866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-rqflz" (UID: "4ef0201e-2031-49b3-a2ad-49424aa639ac") : secret "networking-console-plugin-cert" not found
Jul 01 18:09:41.748193 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:41.748175    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:41.748289 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:09:41.748275    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls podName:74f37af7-55d5-4a5d-ba56-3a9c475e6f9f nodeName:}" failed. No retries permitted until 2026-07-01 18:09:57.748258739 +0000 UTC m=+259.859834190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-xdj5w" (UID: "74f37af7-55d5-4a5d-ba56-3a9c475e6f9f") : secret "cluster-monitoring-operator-tls" not found
Jul 01 18:09:41.837650 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.837620    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:41.858173 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:41.858144    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7654b5cf6f-flhh8"]
Jul 01 18:09:41.861615 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:41.861586    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5960b9b_c236_447e_b8cd_3edba7ca3b74.slice/crio-d81d25e2de5ddeefd8dd5b1ff233692843f734359f532a9514179337569bec8a WatchSource:0}: Error finding container d81d25e2de5ddeefd8dd5b1ff233692843f734359f532a9514179337569bec8a: Status 404 returned error can't find the container with id d81d25e2de5ddeefd8dd5b1ff233692843f734359f532a9514179337569bec8a
Jul 01 18:09:42.340678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.340642    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:42.417043 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.417007    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" event={"ID":"d5960b9b-c236-447e-b8cd-3edba7ca3b74","Type":"ContainerStarted","Data":"0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948"}
Jul 01 18:09:42.417220 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.417061    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" event={"ID":"d5960b9b-c236-447e-b8cd-3edba7ca3b74","Type":"ContainerStarted","Data":"d81d25e2de5ddeefd8dd5b1ff233692843f734359f532a9514179337569bec8a"}
Jul 01 18:09:42.417220 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.417095    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:09:42.436491 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.436416    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" podStartSLOduration=17.436399432 podStartE2EDuration="17.436399432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:42.435698223 +0000 UTC m=+244.547273695" watchObservedRunningTime="2026-07-01 18:09:42.436399432 +0000 UTC m=+244.547974903"
Jul 01 18:09:42.521777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.521740    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:42.737719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:42.737639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:43.133689 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:43.133658    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:43.341485 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:43.341451    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:43.737668 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:43.737638    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:44.004557 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:44.004452    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:44.333659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:44.333623    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:44.932061 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:44.932027    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:46.893452 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:46.893417    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:46.893893 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:46.893471    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:46.893958 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:46.893941    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6bd40db-b821-4a92-8e59-5e4793a04400-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:46.895748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:46.895724    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6bd40db-b821-4a92-8e59-5e4793a04400-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lfktk\" (UID: \"c6bd40db-b821-4a92-8e59-5e4793a04400\") " pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:47.039507 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:47.039473    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kr6bt\""
Jul 01 18:09:47.047767 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:47.047745    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lfktk"
Jul 01 18:09:47.175717 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:47.175628    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lfktk"]
Jul 01 18:09:47.180516 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:47.180487    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bd40db_b821_4a92_8e59_5e4793a04400.slice/crio-4156e60d667ac4e4765edfc68f0ebb3bd5eac650fc87cf9c6a6236bc20935d5c WatchSource:0}: Error finding container 4156e60d667ac4e4765edfc68f0ebb3bd5eac650fc87cf9c6a6236bc20935d5c: Status 404 returned error can't find the container with id 4156e60d667ac4e4765edfc68f0ebb3bd5eac650fc87cf9c6a6236bc20935d5c
Jul 01 18:09:47.433957 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:47.433875    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lfktk" event={"ID":"c6bd40db-b821-4a92-8e59-5e4793a04400","Type":"ContainerStarted","Data":"4156e60d667ac4e4765edfc68f0ebb3bd5eac650fc87cf9c6a6236bc20935d5c"}
Jul 01 18:09:48.559996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:48.559958    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:49.184915 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:49.184878    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:49.286456 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:49.286425    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:49.642978 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:49.642947    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:49.835641 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:49.835608    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:49.887692 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:49.887657    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:50.009370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.009297    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:50.063986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.063959    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:50.218856 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.218824    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:50.626492 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.626461    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:09:50.628869 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.628840    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6130bf2-008d-4c26-b82d-7086ec17eb4d-metrics-certs\") pod \"network-metrics-daemon-gkpld\" (UID: \"c6130bf2-008d-4c26-b82d-7086ec17eb4d\") " pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:09:50.781587 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.781548    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:50.881959 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.881878    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:50.901333 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.901298    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwcg\""
Jul 01 18:09:50.909624 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:50.909584    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkpld"
Jul 01 18:09:51.067156 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:51.067125    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkpld"]
Jul 01 18:09:51.070285 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:51.070255    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6130bf2_008d_4c26_b82d_7086ec17eb4d.slice/crio-cbb85a991cba2b59f09672e70fda03d6af36df6077d349033561a1b01d6aa2ec WatchSource:0}: Error finding container cbb85a991cba2b59f09672e70fda03d6af36df6077d349033561a1b01d6aa2ec: Status 404 returned error can't find the container with id cbb85a991cba2b59f09672e70fda03d6af36df6077d349033561a1b01d6aa2ec
Jul 01 18:09:51.448919 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:51.448881    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lfktk" event={"ID":"c6bd40db-b821-4a92-8e59-5e4793a04400","Type":"ContainerStarted","Data":"5c46137c436bb88b872a50b4a60df0719ebe4b74dee57fb094c25fb84df7eef5"}
Jul 01 18:09:51.450191 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:51.450164    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkpld" event={"ID":"c6130bf2-008d-4c26-b82d-7086ec17eb4d","Type":"ContainerStarted","Data":"cbb85a991cba2b59f09672e70fda03d6af36df6077d349033561a1b01d6aa2ec"}
Jul 01 18:09:51.452833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:51.452810    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:51.833896 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:51.833865    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:52.009369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:52.009341    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:52.456417 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:52.456296    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lfktk" event={"ID":"c6bd40db-b821-4a92-8e59-5e4793a04400","Type":"ContainerStarted","Data":"f2c3324dbc3e5abb8ba618871723a238a07e8210a35cbb6b88537c5b777df8fa"}
Jul 01 18:09:52.458252 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:52.458223    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkpld" event={"ID":"c6130bf2-008d-4c26-b82d-7086ec17eb4d","Type":"ContainerStarted","Data":"f31d7141d6fc6b782ce46d46148a6bf7f7c3fe9cb89e8b24fa470c6019c19b7e"}
Jul 01 18:09:52.458392 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:52.458271    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkpld" event={"ID":"c6130bf2-008d-4c26-b82d-7086ec17eb4d","Type":"ContainerStarted","Data":"93cde2125b8b68a84f8af6c73e50d56e9591629b92825db07a74556a8a2ba184"}
Jul 01 18:09:52.474415 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:52.474367    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gkpld" podStartSLOduration=252.409038623 podStartE2EDuration="4m13.474349512s" totalImagesPullingTime="1.065310889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:52.473771141 +0000 UTC m=+254.585346614" watchObservedRunningTime="2026-07-01 18:09:52.474349512 +0000 UTC m=+254.585925013"
Jul 01 18:09:53.031325 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:53.031290    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:53.130579 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:53.130550    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:54.467970 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:54.467937    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lfktk" event={"ID":"c6bd40db-b821-4a92-8e59-5e4793a04400","Type":"ContainerStarted","Data":"ea5e6c7f4f5e851abe9fe33c14b849770e2a945a64da7b8bcdabe9dcfe638e55"}
Jul 01 18:09:54.485829 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:54.485784    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lfktk" podStartSLOduration=16.561308359 podStartE2EDuration="23.485767622s" totalImagesPullingTime="6.924459263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:09:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:54.484937056 +0000 UTC m=+256.596512557" watchObservedRunningTime="2026-07-01 18:09:54.485767622 +0000 UTC m=+256.597343096"
Jul 01 18:09:57.790291 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:57.790255    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:57.790701 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:57.790311    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:57.792673 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:57.792652    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f37af7-55d5-4a5d-ba56-3a9c475e6f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-xdj5w\" (UID: \"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:57.792791 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:57.792769    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ef0201e-2031-49b3-a2ad-49424aa639ac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-rqflz\" (UID: \"4ef0201e-2031-49b3-a2ad-49424aa639ac\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:58.021754 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.021723    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rzqs5\""
Jul 01 18:09:58.027014 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.026989    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rrzqj\""
Jul 01 18:09:58.029757 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.029737    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"
Jul 01 18:09:58.034968 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.034952    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"
Jul 01 18:09:58.075499 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.075416    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4bb77857-ng925"]
Jul 01 18:09:58.079941 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.079914    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.082645 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.082578    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 01 18:09:58.083572 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.083255    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 01 18:09:58.084214 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.084191    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 01 18:09:58.084565 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.084517    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 01 18:09:58.087021 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.086585    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 01 18:09:58.087021 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.086788    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 01 18:09:58.088212 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.087705    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kq5x2\""
Jul 01 18:09:58.088212 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.087913    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 01 18:09:58.101259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.101222    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4bb77857-ng925"]
Jul 01 18:09:58.160368 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.160340    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7654b5cf6f-flhh8"]
Jul 01 18:09:58.165209 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.165177    2555 patch_prober.go:28] interesting pod/image-registry-7654b5cf6f-flhh8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:09:58.165371 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.165228    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:09:58.176200 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.176171    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz"]
Jul 01 18:09:58.179325 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:58.179294    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef0201e_2031_49b3_a2ad_49424aa639ac.slice/crio-376ca51a71ba2e67ffacee3f228b76d6082161b00ee1f171f0037ba7a62e873c WatchSource:0}: Error finding container 376ca51a71ba2e67ffacee3f228b76d6082161b00ee1f171f0037ba7a62e873c: Status 404 returned error can't find the container with id 376ca51a71ba2e67ffacee3f228b76d6082161b00ee1f171f0037ba7a62e873c
Jul 01 18:09:58.193864 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.193822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-oauth-config\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.194020 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.193881    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-config\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.194020 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.193959    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-oauth-serving-cert\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.194020 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.193999    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-service-ca\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.194180 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.194041    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-serving-cert\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.194180 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.194067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtbf\" (UniqueName: \"kubernetes.io/projected/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-kube-api-access-9xtbf\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.194308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.194288    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w"]
Jul 01 18:09:58.195921 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.195898    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:58.197643 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:58.197619    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f37af7_55d5_4a5d_ba56_3a9c475e6f9f.slice/crio-4596e16c5611b9f11966e8434f5069ea489e45495a0eace86f768cb233128e43 WatchSource:0}: Error finding container 4596e16c5611b9f11966e8434f5069ea489e45495a0eace86f768cb233128e43: Status 404 returned error can't find the container with id 4596e16c5611b9f11966e8434f5069ea489e45495a0eace86f768cb233128e43
Jul 01 18:09:58.217894 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.217866    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5444d8698d-9mc66"]
Jul 01 18:09:58.222210 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.222185    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.232874 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.232850    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5444d8698d-9mc66"]
Jul 01 18:09:58.293711 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.293626    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:09:58.294702 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.294684    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-oauth-serving-cert\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.294748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.294716    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-service-ca\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.294748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.294743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-serving-cert\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.294832 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.294758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtbf\" (UniqueName: \"kubernetes.io/projected/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-kube-api-access-9xtbf\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.294832 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.294773    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-oauth-config\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.294832 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.294797    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-config\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.295440 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.295415    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-service-ca\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.295578 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.295482    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-oauth-serving-cert\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.295578 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.295515    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-config\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.297111 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.297095    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-oauth-config\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.297210 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.297193    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-serving-cert\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.302346 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.302325    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtbf\" (UniqueName: \"kubernetes.io/projected/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-kube-api-access-9xtbf\") pod \"console-6f4bb77857-ng925\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") " pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.394195 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.394164    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:09:58.395416 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395392    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-bound-sa-token\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395516 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395427    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a27cbda6-45aa-428a-af75-698d0b8cdd41-registry-certificates\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395620 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395513    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbp4\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-kube-api-access-mwbp4\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395680 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395632    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-registry-tls\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395680 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395670    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a27cbda6-45aa-428a-af75-698d0b8cdd41-installation-pull-secrets\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395781 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395710    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a27cbda6-45aa-428a-af75-698d0b8cdd41-image-registry-private-configuration\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395781 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a27cbda6-45aa-428a-af75-698d0b8cdd41-ca-trust-extracted\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.395781 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.395769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a27cbda6-45aa-428a-af75-698d0b8cdd41-trusted-ca\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.481860 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.481823    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w" event={"ID":"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f","Type":"ContainerStarted","Data":"4596e16c5611b9f11966e8434f5069ea489e45495a0eace86f768cb233128e43"}
Jul 01 18:09:58.483028 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.482998    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz" event={"ID":"4ef0201e-2031-49b3-a2ad-49424aa639ac","Type":"ContainerStarted","Data":"376ca51a71ba2e67ffacee3f228b76d6082161b00ee1f171f0037ba7a62e873c"}
Jul 01 18:09:58.496354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496302    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbp4\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-kube-api-access-mwbp4\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496405    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-registry-tls\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496440    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a27cbda6-45aa-428a-af75-698d0b8cdd41-installation-pull-secrets\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496483    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a27cbda6-45aa-428a-af75-698d0b8cdd41-image-registry-private-configuration\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a27cbda6-45aa-428a-af75-698d0b8cdd41-ca-trust-extracted\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496583    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a27cbda6-45aa-428a-af75-698d0b8cdd41-trusted-ca\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496613    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-bound-sa-token\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.496842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.496639    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a27cbda6-45aa-428a-af75-698d0b8cdd41-registry-certificates\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.497394 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.497364    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a27cbda6-45aa-428a-af75-698d0b8cdd41-ca-trust-extracted\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.497785 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.497754    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a27cbda6-45aa-428a-af75-698d0b8cdd41-registry-certificates\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.498208 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.498179    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a27cbda6-45aa-428a-af75-698d0b8cdd41-trusted-ca\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.499000 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.498971    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a27cbda6-45aa-428a-af75-698d0b8cdd41-image-registry-private-configuration\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.499000 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.498983    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a27cbda6-45aa-428a-af75-698d0b8cdd41-installation-pull-secrets\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.499157 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.499098    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-registry-tls\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.504024 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.504004    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-bound-sa-token\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.504204 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.504185    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbp4\" (UniqueName: \"kubernetes.io/projected/a27cbda6-45aa-428a-af75-698d0b8cdd41-kube-api-access-mwbp4\") pod \"image-registry-5444d8698d-9mc66\" (UID: \"a27cbda6-45aa-428a-af75-698d0b8cdd41\") " pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.526438 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.526409    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4bb77857-ng925"]
Jul 01 18:09:58.530126 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:58.530101    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6de5e46_f5dc_4600_8fa5_0c3db85c3ce6.slice/crio-fb0bec58f9dabc0723a0faa978f4d60abf31a965603572e43ba8dcd45053fc50 WatchSource:0}: Error finding container fb0bec58f9dabc0723a0faa978f4d60abf31a965603572e43ba8dcd45053fc50: Status 404 returned error can't find the container with id fb0bec58f9dabc0723a0faa978f4d60abf31a965603572e43ba8dcd45053fc50
Jul 01 18:09:58.530895 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.530878    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:58.661621 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:58.661589    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5444d8698d-9mc66"]
Jul 01 18:09:58.664395 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:09:58.664368    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda27cbda6_45aa_428a_af75_698d0b8cdd41.slice/crio-97bca7f6a25c8ee82c56149f2503e7302cef4130b1199d791146572897385df7 WatchSource:0}: Error finding container 97bca7f6a25c8ee82c56149f2503e7302cef4130b1199d791146572897385df7: Status 404 returned error can't find the container with id 97bca7f6a25c8ee82c56149f2503e7302cef4130b1199d791146572897385df7
Jul 01 18:09:59.488778 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:59.488674    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5444d8698d-9mc66" event={"ID":"a27cbda6-45aa-428a-af75-698d0b8cdd41","Type":"ContainerStarted","Data":"fe67c5f3270aa1b5788eceb8c7b85ed15847944077ea6e889e335539e8dc20ae"}
Jul 01 18:09:59.488778 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:59.488736    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5444d8698d-9mc66" event={"ID":"a27cbda6-45aa-428a-af75-698d0b8cdd41","Type":"ContainerStarted","Data":"97bca7f6a25c8ee82c56149f2503e7302cef4130b1199d791146572897385df7"}
Jul 01 18:09:59.489241 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:59.488787    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:09:59.490175 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:59.490149    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4bb77857-ng925" event={"ID":"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6","Type":"ContainerStarted","Data":"fb0bec58f9dabc0723a0faa978f4d60abf31a965603572e43ba8dcd45053fc50"}
Jul 01 18:09:59.511654 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:09:59.511601    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5444d8698d-9mc66" podStartSLOduration=1.5115833379999999 podStartE2EDuration="1.511583338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:09:59.510409168 +0000 UTC m=+261.621984641" watchObservedRunningTime="2026-07-01 18:09:59.511583338 +0000 UTC m=+261.623158810"
Jul 01 18:10:00.496487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:00.496345    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz" event={"ID":"4ef0201e-2031-49b3-a2ad-49424aa639ac","Type":"ContainerStarted","Data":"3db0a28c235586eb118740da7f5fb457f282160ac8e3256bd7b7fd06217c215b"}
Jul 01 18:10:00.514400 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:00.514259    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-rqflz" podStartSLOduration=33.550244695 podStartE2EDuration="35.514239118s" totalImagesPullingTime="1.963994423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:00.513139534 +0000 UTC m=+262.624715010" watchObservedRunningTime="2026-07-01 18:10:00.514239118 +0000 UTC m=+262.625814592"
Jul 01 18:10:00.609917 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:00.609881    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:00.668917 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:00.668845    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:01.157074 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:01.157024    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:01.259021 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:01.258982    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.506199 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.506097    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.508640 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.508613    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4bb77857-ng925" event={"ID":"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6","Type":"ContainerStarted","Data":"4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf"}
Jul 01 18:10:03.510036 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.510012    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w" event={"ID":"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f","Type":"ContainerStarted","Data":"38997995ffad8b632f2cdbfd9bc1091c988f76cbf09a7b28ec206a0ee7b0ba58"}
Jul 01 18:10:03.541798 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.541737    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4bb77857-ng925" podStartSLOduration=0.952903997 podStartE2EDuration="5.541721499s" totalImagesPullingTime="4.588817502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:03.540847274 +0000 UTC m=+265.652422757" watchObservedRunningTime="2026-07-01 18:10:03.541721499 +0000 UTC m=+265.653296971"
Jul 01 18:10:03.557356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.557302    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w" podStartSLOduration=33.641749916 podStartE2EDuration="38.557284855s" totalImagesPullingTime="4.915534939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:03.556438326 +0000 UTC m=+265.668013811" watchObservedRunningTime="2026-07-01 18:10:03.557284855 +0000 UTC m=+265.668860327"
Jul 01 18:10:03.611984 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.611951    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.696165 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.696111    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.894998 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:03.894947    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:04.485805 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:04.485758    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:04.684300 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:04.684264    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:07.720131 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.720067    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:07.776599 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.776562    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:07.780235 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.780211    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"]
Jul 01 18:10:07.783013 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.782995    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.785539 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.785509    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 01 18:10:07.785665 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.785563    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 01 18:10:07.786576 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.786543    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 01 18:10:07.786691 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.786612    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qxffg\""
Jul 01 18:10:07.796773 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.796741    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"]
Jul 01 18:10:07.877395 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.877366    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdfv\" (UniqueName: \"kubernetes.io/projected/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-kube-api-access-wsdfv\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.877569 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.877406    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.877569 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.877442    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.877569 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.877482    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.978658 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.978580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdfv\" (UniqueName: \"kubernetes.io/projected/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-kube-api-access-wsdfv\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.978658 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.978623    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.978874 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.978738    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.978874 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.978802    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.978963 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:07.978878    2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 01 18:10:07.978963 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:07.978951    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-tls podName:b4e0eec2-372a-49fe-864e-ee0b4fcc5048 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:08.478930259 +0000 UTC m=+270.590505720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-jdt9l" (UID: "b4e0eec2-372a-49fe-864e-ee0b4fcc5048") : secret "prometheus-operator-tls" not found
Jul 01 18:10:07.979375 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.979353    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.981265 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.981239    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:07.988248 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:07.988222    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdfv\" (UniqueName: \"kubernetes.io/projected/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-kube-api-access-wsdfv\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:08.038650 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.038605    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:08.091711 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.091678    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:08.164903 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.164863    2555 patch_prober.go:28] interesting pod/image-registry-7654b5cf6f-flhh8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:08.165040 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.164930    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:08.394437 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.394394    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:10:08.394648 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.394483    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:10:08.395802 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.395777    2555 patch_prober.go:28] interesting pod/console-6f4bb77857-ng925 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Jul 01 18:10:08.395924 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.395826    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f4bb77857-ng925" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Jul 01 18:10:08.482959 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.482922    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:08.485339 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.485307    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4e0eec2-372a-49fe-864e-ee0b4fcc5048-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-jdt9l\" (UID: \"b4e0eec2-372a-49fe-864e-ee0b4fcc5048\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:08.563489 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.563456    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:08.691722 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.691638    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"
Jul 01 18:10:08.824782 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:08.824751    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-jdt9l"]
Jul 01 18:10:08.827895 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:10:08.827871    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e0eec2_372a_49fe_864e_ee0b4fcc5048.slice/crio-2b6538979938b98298b3c616779345cc523af0b8048b0a8176fd1e10b01fef68 WatchSource:0}: Error finding container 2b6538979938b98298b3c616779345cc523af0b8048b0a8176fd1e10b01fef68: Status 404 returned error can't find the container with id 2b6538979938b98298b3c616779345cc523af0b8048b0a8176fd1e10b01fef68
Jul 01 18:10:09.530081 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:09.530049    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l" event={"ID":"b4e0eec2-372a-49fe-864e-ee0b4fcc5048","Type":"ContainerStarted","Data":"2b6538979938b98298b3c616779345cc523af0b8048b0a8176fd1e10b01fef68"}
Jul 01 18:10:10.534699 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:10.534665    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l" event={"ID":"b4e0eec2-372a-49fe-864e-ee0b4fcc5048","Type":"ContainerStarted","Data":"de83f2483fd0d7c3f0463ef530d97f1782c6aee19bf395e70c509327c8af71b7"}
Jul 01 18:10:10.702109 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:10.702028    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:11.539036 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:11.539002    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l" event={"ID":"b4e0eec2-372a-49fe-864e-ee0b4fcc5048","Type":"ContainerStarted","Data":"8faa035da55ff15de3c8c57f772f98fc667cbac5a6057fac389d815ec0bcf990"}
Jul 01 18:10:11.558983 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:11.558930    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-jdt9l" podStartSLOduration=2.9347278169999997 podStartE2EDuration="4.558908622s" totalImagesPullingTime="1.624180805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:11.556784393 +0000 UTC m=+273.668359870" watchObservedRunningTime="2026-07-01 18:10:11.558908622 +0000 UTC m=+273.670484099"
Jul 01 18:10:12.875363 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:12.875335    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:13.120106 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.120075    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:13.220966 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.220886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:13.274925 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.274894    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:13.546887 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.546864    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:10:13.547058 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.546897    2555 generic.go:356] "Generic (PLEG): container finished" podID="74f37af7-55d5-4a5d-ba56-3a9c475e6f9f" containerID="38997995ffad8b632f2cdbfd9bc1091c988f76cbf09a7b28ec206a0ee7b0ba58" exitCode=2
Jul 01 18:10:13.547058 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.546965    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w" event={"ID":"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f","Type":"ContainerDied","Data":"38997995ffad8b632f2cdbfd9bc1091c988f76cbf09a7b28ec206a0ee7b0ba58"}
Jul 01 18:10:13.547313 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:13.547300    2555 scope.go:117] "RemoveContainer" containerID="38997995ffad8b632f2cdbfd9bc1091c988f76cbf09a7b28ec206a0ee7b0ba58"
Jul 01 18:10:14.437420 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:14.437387    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:14.552418 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:14.552388    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:10:14.552602 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:14.552454    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-xdj5w" event={"ID":"74f37af7-55d5-4a5d-ba56-3a9c475e6f9f","Type":"ContainerStarted","Data":"3b4d83a29c107c40f3b444777fac3f03e10619329b261eb508931baea8ecaa6c"}
Jul 01 18:10:14.824634 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:14.824594    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.755051 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:15.755017    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.855239 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:15.855205    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.921459 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:15.921433    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.198775 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.198740    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.277684 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.277657    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.317507 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.317475    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fqnf5"]
Jul 01 18:10:17.320448 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.320428    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.322748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.322726    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 01 18:10:17.322889 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.322867    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 01 18:10:17.323007 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.322992    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rtf57\""
Jul 01 18:10:17.323134 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.323118    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 01 18:10:17.347593 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347565    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-wtmp\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347705 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347601    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347705 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347628    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-textfile\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347705 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng2t9\" (UniqueName: \"kubernetes.io/projected/8ae24a19-279d-411f-b72d-8095dd8fd721-kube-api-access-ng2t9\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347705 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347673    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-sys\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347705 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347695    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-tls\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347951 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347724    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ae24a19-279d-411f-b72d-8095dd8fd721-metrics-client-ca\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347951 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347825    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-root\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.347951 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.347866    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-accelerators-collector-config\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448641 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-wtmp\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448641 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448634    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448667    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-textfile\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng2t9\" (UniqueName: \"kubernetes.io/projected/8ae24a19-279d-411f-b72d-8095dd8fd721-kube-api-access-ng2t9\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448719    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-sys\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448754    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-tls\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ae24a19-279d-411f-b72d-8095dd8fd721-metrics-client-ca\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448849    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-root\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.448929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.448881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-accelerators-collector-config\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.449261 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:17.449037    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 01 18:10:17.449261 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:17.449107    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-tls podName:8ae24a19-279d-411f-b72d-8095dd8fd721 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:17.949085125 +0000 UTC m=+280.060660582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-tls") pod "node-exporter-fqnf5" (UID: "8ae24a19-279d-411f-b72d-8095dd8fd721") : secret "node-exporter-tls" not found
Jul 01 18:10:17.449373 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.449320    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-root\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.449426 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.449382    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-sys\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.449575 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.449555    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-wtmp\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.449707 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.449572    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ae24a19-279d-411f-b72d-8095dd8fd721-metrics-client-ca\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.449707 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.449692    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-textfile\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.449930 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.449905    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-accelerators-collector-config\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.452014 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.451993    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.457313 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.457284    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng2t9\" (UniqueName: \"kubernetes.io/projected/8ae24a19-279d-411f-b72d-8095dd8fd721-kube-api-access-ng2t9\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.484823 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.484792    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.941801 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.941768    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.952091 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.952065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-tls\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:17.954356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:17.954325    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ae24a19-279d-411f-b72d-8095dd8fd721-node-exporter-tls\") pod \"node-exporter-fqnf5\" (UID: \"8ae24a19-279d-411f-b72d-8095dd8fd721\") " pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:18.024300 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.024267    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:18.165019 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.164985    2555 patch_prober.go:28] interesting pod/image-registry-7654b5cf6f-flhh8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:18.165199 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.165041    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:18.214414 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.214330    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:18.230543 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.230498    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fqnf5"
Jul 01 18:10:18.240649 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:10:18.240617    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae24a19_279d_411f_b72d_8095dd8fd721.slice/crio-41780bf01a0db9cab906bfdbb33d236ce84fbdac5a75b7aa8c53b45744ef9cae WatchSource:0}: Error finding container 41780bf01a0db9cab906bfdbb33d236ce84fbdac5a75b7aa8c53b45744ef9cae: Status 404 returned error can't find the container with id 41780bf01a0db9cab906bfdbb33d236ce84fbdac5a75b7aa8c53b45744ef9cae
Jul 01 18:10:18.302842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.302811    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:18.395371 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.395337    2555 patch_prober.go:28] interesting pod/console-6f4bb77857-ng925 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Jul 01 18:10:18.395595 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.395396    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f4bb77857-ng925" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Jul 01 18:10:18.537070 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.537041    2555 patch_prober.go:28] interesting pod/image-registry-5444d8698d-9mc66 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:18.537253 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.537095    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5444d8698d-9mc66" podUID="a27cbda6-45aa-428a-af75-698d0b8cdd41" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:18.570721 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.570684    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqnf5" event={"ID":"8ae24a19-279d-411f-b72d-8095dd8fd721","Type":"ContainerStarted","Data":"41780bf01a0db9cab906bfdbb33d236ce84fbdac5a75b7aa8c53b45744ef9cae"}
Jul 01 18:10:18.878848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:18.878754    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:19.290102 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:19.290073    2555 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae24a19_279d_411f_b72d_8095dd8fd721.slice/crio-0394ae275f26c7d2e4b2c0fa25d58a19c35ff5832f3eb779863c9228365a7161.scope\": RecentStats: unable to find data in memory cache]"
Jul 01 18:10:19.575351 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:19.575314    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ae24a19-279d-411f-b72d-8095dd8fd721" containerID="0394ae275f26c7d2e4b2c0fa25d58a19c35ff5832f3eb779863c9228365a7161" exitCode=0
Jul 01 18:10:19.575560 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:19.575398    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqnf5" event={"ID":"8ae24a19-279d-411f-b72d-8095dd8fd721","Type":"ContainerDied","Data":"0394ae275f26c7d2e4b2c0fa25d58a19c35ff5832f3eb779863c9228365a7161"}
Jul 01 18:10:20.174941 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.174909    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:20.193093 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:20.193053    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qdwg7" podUID="d8959a7b-56e5-4c96-8561-2ab4288cb369"
Jul 01 18:10:20.276093 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.276061    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:20.500721 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.500643    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5444d8698d-9mc66"
Jul 01 18:10:20.581690 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.581653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqnf5" event={"ID":"8ae24a19-279d-411f-b72d-8095dd8fd721","Type":"ContainerStarted","Data":"cf9e41e57e937800663d2ec6d1cd1cc1abbe9c5458dbf10489d3163cc2b793cd"}
Jul 01 18:10:20.581877 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.581694    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:10:20.581877 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.581719    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqnf5" event={"ID":"8ae24a19-279d-411f-b72d-8095dd8fd721","Type":"ContainerStarted","Data":"830923f3f11f317bf76594b211e48b14502a722a9ebcb421292f93fd3a760fbd"}
Jul 01 18:10:20.600319 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.600267    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fqnf5" podStartSLOduration=2.633692405 podStartE2EDuration="3.600251938s" totalImagesPullingTime="898.375785ms" totalInitContainerRuntime="68.183748ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:20.599589358 +0000 UTC m=+282.711164831" watchObservedRunningTime="2026-07-01 18:10:20.600251938 +0000 UTC m=+282.711827488"
Jul 01 18:10:20.629503 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.629447    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:20.683127 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.683087    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:20.736875 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.736847    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:20.830683 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:20.830653    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:21.047587 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.047541    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:21.099694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.099619    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:21.524591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.524491    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9d544f8f9-d54mk"]
Jul 01 18:10:21.526597 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.526582    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.530084 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.530061    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 01 18:10:21.530084 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.530061    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-206j5pb3n287n\""
Jul 01 18:10:21.530270 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.530093    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 01 18:10:21.530270 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.530104    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 01 18:10:21.530270 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.530128    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kscwl\""
Jul 01 18:10:21.530461 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.530444    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 01 18:10:21.538162 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.538142    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9d544f8f9-d54mk"]
Jul 01 18:10:21.578908 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.578862    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.578908 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.578915    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-secret-metrics-server-client-certs\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.579116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.578939    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-client-ca-bundle\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.579116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.579025    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tsws\" (UniqueName: \"kubernetes.io/projected/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-kube-api-access-2tsws\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.579116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.579063    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-metrics-server-audit-profiles\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.579116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.579086    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-audit-log\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.579233 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.579139    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-secret-metrics-server-tls\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680230 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680194    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680255    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-secret-metrics-server-client-certs\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680282    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-client-ca-bundle\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680361    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tsws\" (UniqueName: \"kubernetes.io/projected/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-kube-api-access-2tsws\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680588    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-metrics-server-audit-profiles\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680704 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680686    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-audit-log\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.680761 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680724    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-secret-metrics-server-tls\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.681023 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.680996    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.681147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.681121    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-audit-log\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.681591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.681560    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-metrics-server-audit-profiles\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.682952 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.682931    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-secret-metrics-server-client-certs\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.683118 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.683096    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-client-ca-bundle\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.683168 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.683154    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-secret-metrics-server-tls\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.688828 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.688805    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tsws\" (UniqueName: \"kubernetes.io/projected/2005efb6-cb0a-4fba-b6be-9f8dcd6510e1-kube-api-access-2tsws\") pod \"metrics-server-9d544f8f9-d54mk\" (UID: \"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1\") " pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.836364 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.836327    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:21.973030 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:21.972986    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9d544f8f9-d54mk"]
Jul 01 18:10:21.976222 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:10:21.976193    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2005efb6_cb0a_4fba_b6be_9f8dcd6510e1.slice/crio-4ec9d219ce81193d03a48fc10afcfb684b8dccff3a37d504f2ad50bb6ea9dacc WatchSource:0}: Error finding container 4ec9d219ce81193d03a48fc10afcfb684b8dccff3a37d504f2ad50bb6ea9dacc: Status 404 returned error can't find the container with id 4ec9d219ce81193d03a48fc10afcfb684b8dccff3a37d504f2ad50bb6ea9dacc
Jul 01 18:10:22.023207 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.023173    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:22.031992 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.031965    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4bb77857-ng925"]
Jul 01 18:10:22.073180 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.073148    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8686d9d6b9-jhrhb"]
Jul 01 18:10:22.076089 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.076065    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.083712 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083686    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-oauth-serving-cert\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.083848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083711    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 01 18:10:22.083848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083738    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-oauth-config\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.083848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083772    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-serving-cert\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.083848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083805    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-trusted-ca-bundle\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.084182 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-console-config\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.084182 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083965    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvldx\" (UniqueName: \"kubernetes.io/projected/07d8497b-9534-486a-8b26-9edf59166f0f-kube-api-access-fvldx\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.084182 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.083991    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-service-ca\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.088399 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.088337    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8686d9d6b9-jhrhb"]
Jul 01 18:10:22.118147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.118119    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:22.184717 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184685    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-trusted-ca-bundle\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.184870 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-console-config\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.184870 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184780    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvldx\" (UniqueName: \"kubernetes.io/projected/07d8497b-9534-486a-8b26-9edf59166f0f-kube-api-access-fvldx\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.184870 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184804    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-service-ca\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.184870 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184864    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-oauth-serving-cert\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.185038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184911    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-oauth-config\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.185038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.184942    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-serving-cert\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.185645 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.185604    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-service-ca\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.185645 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.185626    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-console-config\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.185935 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.185910    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-trusted-ca-bundle\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.186049 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.186000    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-oauth-serving-cert\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.187381 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.187364    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-serving-cert\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.187618 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.187596    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-oauth-config\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.193028 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.193008    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvldx\" (UniqueName: \"kubernetes.io/projected/07d8497b-9534-486a-8b26-9edf59166f0f-kube-api-access-fvldx\") pod \"console-8686d9d6b9-jhrhb\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") " pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.387169 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.387088    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:22.433617 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.433584    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:22.516575 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.516502    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8686d9d6b9-jhrhb"]
Jul 01 18:10:22.519068 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:10:22.519036    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d8497b_9534_486a_8b26_9edf59166f0f.slice/crio-2f610016deac074fb3a9cabff0968773c7d765d0d6e52e88f3df64c3dec5f145 WatchSource:0}: Error finding container 2f610016deac074fb3a9cabff0968773c7d765d0d6e52e88f3df64c3dec5f145: Status 404 returned error can't find the container with id 2f610016deac074fb3a9cabff0968773c7d765d0d6e52e88f3df64c3dec5f145
Jul 01 18:10:22.589883 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.589848    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk" event={"ID":"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1","Type":"ContainerStarted","Data":"4ec9d219ce81193d03a48fc10afcfb684b8dccff3a37d504f2ad50bb6ea9dacc"}
Jul 01 18:10:22.591340 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.591317    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8686d9d6b9-jhrhb" event={"ID":"07d8497b-9534-486a-8b26-9edf59166f0f","Type":"ContainerStarted","Data":"1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc"}
Jul 01 18:10:22.591457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.591354    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8686d9d6b9-jhrhb" event={"ID":"07d8497b-9534-486a-8b26-9edf59166f0f","Type":"ContainerStarted","Data":"2f610016deac074fb3a9cabff0968773c7d765d0d6e52e88f3df64c3dec5f145"}
Jul 01 18:10:22.611407 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:22.611356    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8686d9d6b9-jhrhb" podStartSLOduration=0.611338817 podStartE2EDuration="611.338817ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:22.610851104 +0000 UTC m=+284.722426604" watchObservedRunningTime="2026-07-01 18:10:22.611338817 +0000 UTC m=+284.722914288"
Jul 01 18:10:23.183178 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.183132    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry" containerID="cri-o://0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948" gracePeriod=30
Jul 01 18:10:23.194146 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.194111    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:10:23.196351 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.196323    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8959a7b-56e5-4c96-8561-2ab4288cb369-metrics-tls\") pod \"dns-default-qdwg7\" (UID: \"d8959a7b-56e5-4c96-8561-2ab4288cb369\") " pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:10:23.285745 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.285710    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x5l6c\""
Jul 01 18:10:23.294104 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.294070    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:10:23.470982 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.470935    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:10:23.477616 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.476606    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qdwg7"]
Jul 01 18:10:23.481704 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.481676    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.482306 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:10:23.482280    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8959a7b_56e5_4c96_8561_2ab4288cb369.slice/crio-4c8417a409e07cb693a9deb2ed4bfd459491242da201518e32edeba013fe07dc WatchSource:0}: Error finding container 4c8417a409e07cb693a9deb2ed4bfd459491242da201518e32edeba013fe07dc: Status 404 returned error can't find the container with id 4c8417a409e07cb693a9deb2ed4bfd459491242da201518e32edeba013fe07dc
Jul 01 18:10:23.489975 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.489953    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 18:10:23.490268 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.490253    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry"
Jul 01 18:10:23.490268 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.490268    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry"
Jul 01 18:10:23.490413 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.490399    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerName="registry"
Jul 01 18:10:23.494762 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.494737    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497094    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nk5v\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-kube-api-access-6nk5v\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497118    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497148    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-certificates\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497178    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497204    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497151    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 01 18:10:23.497388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497208    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-bound-sa-token\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497404    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-trusted-ca\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497451    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-installation-pull-secrets\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497488    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5960b9b-c236-447e-b8cd-3edba7ca3b74-ca-trust-extracted\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.497844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497578    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:23.497844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497583    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-image-registry-private-configuration\") pod \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\" (UID: \"d5960b9b-c236-447e-b8cd-3edba7ca3b74\") "
Jul 01 18:10:23.498083 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.497871    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-certificates\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.498415 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.498395    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 01 18:10:23.498817 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.498791    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:23.498916 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.498825    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8panta1d7vbug\""
Jul 01 18:10:23.499015 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.498999    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 01 18:10:23.499223 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.499207    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 01 18:10:23.499442 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.499427    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 01 18:10:23.499659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.499643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-czj27\""
Jul 01 18:10:23.499859 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.499843    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 01 18:10:23.501873 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.501853    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 01 18:10:23.502069 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.502054    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 01 18:10:23.502609 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.502264    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 01 18:10:23.502609 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.502424    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 01 18:10:23.505941 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.505918    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 01 18:10:23.506349 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.506292    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:23.510968 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.510110    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:23.512314 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.511880    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:10:23.512314 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.512006    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5960b9b-c236-447e-b8cd-3edba7ca3b74-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:10:23.516391 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.516364    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-kube-api-access-6nk5v" (OuterVolumeSpecName: "kube-api-access-6nk5v") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "kube-api-access-6nk5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:23.519011 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.518985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 18:10:23.520514 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.520488    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5960b9b-c236-447e-b8cd-3edba7ca3b74" (UID: "d5960b9b-c236-447e-b8cd-3edba7ca3b74"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:10:23.522351 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.522326    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 01 18:10:23.597262 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.597221    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qdwg7" event={"ID":"d8959a7b-56e5-4c96-8561-2ab4288cb369","Type":"ContainerStarted","Data":"4c8417a409e07cb693a9deb2ed4bfd459491242da201518e32edeba013fe07dc"}
Jul 01 18:10:23.598305 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598447 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598327    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598447 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598353    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598447 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598395    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598447 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598460    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598495    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-config\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598601    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598628    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598634    2555 generic.go:356] "Generic (PLEG): container finished" podID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" containerID="0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948" exitCode=0
Jul 01 18:10:23.598651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598650    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-web-config\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598676    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598691    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" event={"ID":"d5960b9b-c236-447e-b8cd-3edba7ca3b74","Type":"ContainerDied","Data":"0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948"}
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598723    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598736    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7654b5cf6f-flhh8" event={"ID":"d5960b9b-c236-447e-b8cd-3edba7ca3b74","Type":"ContainerDied","Data":"d81d25e2de5ddeefd8dd5b1ff233692843f734359f532a9514179337569bec8a"}
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598740    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598764    2555 scope.go:117] "RemoveContainer" containerID="0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598846    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.598986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598952    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46a33874-7e47-4e9c-b123-1fc3bde08780-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.598994    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f74l\" (UniqueName: \"kubernetes.io/projected/46a33874-7e47-4e9c-b123-1fc3bde08780-kube-api-access-9f74l\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599033    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46a33874-7e47-4e9c-b123-1fc3bde08780-config-out\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599111    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-registry-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599126    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-bound-sa-token\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599139    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5960b9b-c236-447e-b8cd-3edba7ca3b74-trusted-ca\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599155    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-installation-pull-secrets\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599168    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5960b9b-c236-447e-b8cd-3edba7ca3b74-ca-trust-extracted\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599178    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5960b9b-c236-447e-b8cd-3edba7ca3b74-image-registry-private-configuration\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.599457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.599187    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nk5v\" (UniqueName: \"kubernetes.io/projected/d5960b9b-c236-447e-b8cd-3edba7ca3b74-kube-api-access-6nk5v\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:23.613224 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.613203    2555 scope.go:117] "RemoveContainer" containerID="0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948"
Jul 01 18:10:23.613653 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:23.613624    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948\": container with ID starting with 0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948 not found: ID does not exist" containerID="0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948"
Jul 01 18:10:23.613753 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.613663    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948"} err="failed to get container status \"0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948\": rpc error: code = NotFound desc = could not find container \"0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948\": container with ID starting with 0c873a94589c5ab9dfd9249ef5001502244fb316f635be63a2c7e650032ad948 not found: ID does not exist"
Jul 01 18:10:23.623471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.623448    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7654b5cf6f-flhh8"]
Jul 01 18:10:23.627100 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.627076    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7654b5cf6f-flhh8"]
Jul 01 18:10:23.638684 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.638655    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.700156 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700112    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700164    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700199    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46a33874-7e47-4e9c-b123-1fc3bde08780-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700224    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f74l\" (UniqueName: \"kubernetes.io/projected/46a33874-7e47-4e9c-b123-1fc3bde08780-kube-api-access-9f74l\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700294    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46a33874-7e47-4e9c-b123-1fc3bde08780-config-out\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700359    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700410    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700432    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700476    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700500    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700554    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.700695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.700607    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-config\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.702096 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.701467    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703399 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703372    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703620 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703598    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703641    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703665    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-web-config\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703736    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.703842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.703770    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.705833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.704016    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.705833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.704672    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.705833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.704953    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.706746 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.706270    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.707771 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.707266    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.707771 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.707621    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46a33874-7e47-4e9c-b123-1fc3bde08780-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.708651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.708560    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.708651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.708571    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-config\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.709193 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.709130    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.709341 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.709319    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.709656 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.709634    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.710446 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.710389    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.710446 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.710421    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.710889 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.710867    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-web-config\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.710980 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.710912    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/46a33874-7e47-4e9c-b123-1fc3bde08780-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.711119 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.711092    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46a33874-7e47-4e9c-b123-1fc3bde08780-config-out\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.712617 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.712587    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/46a33874-7e47-4e9c-b123-1fc3bde08780-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.713212 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.713185    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f74l\" (UniqueName: \"kubernetes.io/projected/46a33874-7e47-4e9c-b123-1fc3bde08780-kube-api-access-9f74l\") pod \"prometheus-k8s-0\" (UID: \"46a33874-7e47-4e9c-b123-1fc3bde08780\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.739099 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.739074    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.820856 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.820821    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:23.973609 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.973481    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.995397 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:23.995336    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 18:10:24.028826 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.028786    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:24.282257 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:10:24.282184    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a33874_7e47_4e9c_b123_1fc3bde08780.slice/crio-1304d34f7e7a785a63059419ee5ba4583c6b6e676bfaa0f2cd8d9bea8d9fd6ef WatchSource:0}: Error finding container 1304d34f7e7a785a63059419ee5ba4583c6b6e676bfaa0f2cd8d9bea8d9fd6ef: Status 404 returned error can't find the container with id 1304d34f7e7a785a63059419ee5ba4583c6b6e676bfaa0f2cd8d9bea8d9fd6ef
Jul 01 18:10:24.397368 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.397330    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:24.497985 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.497907    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:24.605569 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.605017    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk" event={"ID":"2005efb6-cb0a-4fba-b6be-9f8dcd6510e1","Type":"ContainerStarted","Data":"ad3050891b670f7f2f3ed9c0ee7cdc0933851f2efb456ef7f271cf900e7a5504"}
Jul 01 18:10:24.609378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.609349    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"1304d34f7e7a785a63059419ee5ba4583c6b6e676bfaa0f2cd8d9bea8d9fd6ef"}
Jul 01 18:10:24.625066 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.624870    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk" podStartSLOduration=1.293775541 podStartE2EDuration="3.624847794s" totalImagesPullingTime="2.331072253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:24.622848199 +0000 UTC m=+286.734423671" watchObservedRunningTime="2026-07-01 18:10:24.624847794 +0000 UTC m=+286.736423268"
Jul 01 18:10:24.705191 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:24.704869    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5960b9b-c236-447e-b8cd-3edba7ca3b74" path="/var/lib/kubelet/pods/d5960b9b-c236-447e-b8cd-3edba7ca3b74/volumes"
Jul 01 18:10:27.293429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.293401    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:27.393859 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.393832    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:27.608202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.608118    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:27.622988 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.622954    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qdwg7" event={"ID":"d8959a7b-56e5-4c96-8561-2ab4288cb369","Type":"ContainerStarted","Data":"313faf195d9cfbfb3484504dec4c21e46b5e4a8acfdef4d84a9ee164a7689c6c"}
Jul 01 18:10:27.623152 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.623014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qdwg7" event={"ID":"d8959a7b-56e5-4c96-8561-2ab4288cb369","Type":"ContainerStarted","Data":"bfb87a00155dadf88fe96f853d0ac13bb5c69b74b6e22804614248b9ea3707de"}
Jul 01 18:10:27.623152 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.623047    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:10:27.624393 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.624350    2555 generic.go:356] "Generic (PLEG): container finished" podID="46a33874-7e47-4e9c-b123-1fc3bde08780" containerID="664c85a9d8c7488e5fe8a528d4965e3293efab4d95d3617319f9f875ffcca42d" exitCode=0
Jul 01 18:10:27.624492 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.624423    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerDied","Data":"664c85a9d8c7488e5fe8a528d4965e3293efab4d95d3617319f9f875ffcca42d"}
Jul 01 18:10:27.642859 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.642814    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qdwg7" podStartSLOduration=251.517321497 podStartE2EDuration="4m14.642800225s" totalImagesPullingTime="3.125478728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:27.641568674 +0000 UTC m=+289.753144147" watchObservedRunningTime="2026-07-01 18:10:27.642800225 +0000 UTC m=+289.754375696"
Jul 01 18:10:27.672476 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:27.672447    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:31.645887 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:31.645852    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"0373814df5e2e3fd0c39153a5f57748ced83b418cfb75e514877e81a94b9547c"}
Jul 01 18:10:31.646299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:31.645919    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"46a8afb2b8a2d9b84804f7da9af6e8e5b8d396f84e95226db8f70199bd131b43"}
Jul 01 18:10:32.387498 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:32.387463    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:32.387704 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:32.387563    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:32.392616 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:32.392595    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:32.654802 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:32.654712    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:10:32.870042 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:32.870008    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:32.970468 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:32.970396    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:33.067504 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:33.067473    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:35.663660 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:35.663570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"b5d04f9eb7b65ec1afda544aa33dff6d760cc4b69363365dd404e92427186ce0"}
Jul 01 18:10:35.664016 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:35.663674    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"d603007eac50103e6b2217ab47d733b6aeceac3b85b897de910484c82b8bfa62"}
Jul 01 18:10:35.664016 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:35.663702    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"91008d2ab705fc71bdb732cec859c2b1a9fc5c359465ebe40bd60fc342825f45"}
Jul 01 18:10:35.664016 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:35.663727    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"46a33874-7e47-4e9c-b123-1fc3bde08780","Type":"ContainerStarted","Data":"ea459ac05c3ee67bef8333b88a05557b3968044f91d808bb8bb4517ee2fcfd5d"}
Jul 01 18:10:35.691160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:35.691109    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.776025325 podStartE2EDuration="12.691088372s" totalImagesPullingTime="9.898773681s" totalInitContainerRuntime="16.289366ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:35.688988386 +0000 UTC m=+297.800563871" watchObservedRunningTime="2026-07-01 18:10:35.691088372 +0000 UTC m=+297.802663844"
Jul 01 18:10:36.682038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:36.682006    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:36.741476 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:36.741439    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:37.631622 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:37.631591    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qdwg7"
Jul 01 18:10:38.035424 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.035342    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:38.096638 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.096601    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:38.658345 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.658315    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:10:38.659348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.659310    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:10:38.675449 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.675420    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:10:38.677372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.677345    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:10:38.680814 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.680794    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 01 18:10:38.821811 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:38.821777    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:10:41.836694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:41.836651    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:41.837079 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:41.836744    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:10:43.218826 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:43.218788    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.053640 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.053604    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f4bb77857-ng925" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerName="console" containerID="cri-o://4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf" gracePeriod=15
Jul 01 18:10:47.302986 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.302960    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:10:47.431769 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.431673    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-oauth-serving-cert\") pod \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") "
Jul 01 18:10:47.431948 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.431727    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-oauth-config\") pod \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") "
Jul 01 18:10:47.431948 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.431847    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-config\") pod \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") "
Jul 01 18:10:47.431948 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.431883    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-service-ca\") pod \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") "
Jul 01 18:10:47.432113 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.431947    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xtbf\" (UniqueName: \"kubernetes.io/projected/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-kube-api-access-9xtbf\") pod \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") "
Jul 01 18:10:47.432113 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.431994    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-serving-cert\") pod \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\" (UID: \"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6\") "
Jul 01 18:10:47.432218 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.432198    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" (UID: "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:47.432274 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.432259    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-oauth-serving-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:47.432343 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.432316    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" (UID: "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:47.432591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.432561    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-config" (OuterVolumeSpecName: "console-config") pod "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" (UID: "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:47.434643 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.434614    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" (UID: "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:10:47.434748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.434655    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" (UID: "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:10:47.434748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.434702    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-kube-api-access-9xtbf" (OuterVolumeSpecName: "kube-api-access-9xtbf") pod "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" (UID: "e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6"). InnerVolumeSpecName "kube-api-access-9xtbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:47.533348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.533304    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:47.533348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.533338    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-service-ca\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:47.533348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.533350    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xtbf\" (UniqueName: \"kubernetes.io/projected/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-kube-api-access-9xtbf\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:47.533608 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.533364    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-serving-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:47.533608 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.533373    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6-console-oauth-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:10:47.720940 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.720232    2555 generic.go:356] "Generic (PLEG): container finished" podID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerID="4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf" exitCode=0
Jul 01 18:10:47.720940 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.720291    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4bb77857-ng925" event={"ID":"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6","Type":"ContainerDied","Data":"4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf"}
Jul 01 18:10:47.720940 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.720335    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4bb77857-ng925" event={"ID":"e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6","Type":"ContainerDied","Data":"fb0bec58f9dabc0723a0faa978f4d60abf31a965603572e43ba8dcd45053fc50"}
Jul 01 18:10:47.720940 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.720360    2555 scope.go:117] "RemoveContainer" containerID="4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf"
Jul 01 18:10:47.720940 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.720547    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4bb77857-ng925"
Jul 01 18:10:47.733392 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.733347    2555 scope.go:117] "RemoveContainer" containerID="4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf"
Jul 01 18:10:47.733749 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:10:47.733727    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf\": container with ID starting with 4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf not found: ID does not exist" containerID="4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf"
Jul 01 18:10:47.733847 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.733761    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf"} err="failed to get container status \"4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf\": rpc error: code = NotFound desc = could not find container \"4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf\": container with ID starting with 4c39d4e5ee28b98afc6475385408313ed72a0a922bbf94ef79e87bc468871baf not found: ID does not exist"
Jul 01 18:10:47.745484 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.745461    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4bb77857-ng925"]
Jul 01 18:10:47.750990 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:47.750967    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4bb77857-ng925"]
Jul 01 18:10:48.702077 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:48.702043    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" path="/var/lib/kubelet/pods/e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6/volumes"
Jul 01 18:10:50.732995 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:50.732961    2555 generic.go:356] "Generic (PLEG): container finished" podID="e1ebe241-4196-4ecf-899b-4680e42bde79" containerID="fbcaa7112b19c263898e4c69842db952d59092494421ff82ec284323c3fc667c" exitCode=0
Jul 01 18:10:50.733389 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:50.733010    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-s8mwl" event={"ID":"e1ebe241-4196-4ecf-899b-4680e42bde79","Type":"ContainerDied","Data":"fbcaa7112b19c263898e4c69842db952d59092494421ff82ec284323c3fc667c"}
Jul 01 18:10:50.733389 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:50.733372    2555 scope.go:117] "RemoveContainer" containerID="fbcaa7112b19c263898e4c69842db952d59092494421ff82ec284323c3fc667c"
Jul 01 18:10:51.738984 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:51.738951    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-s8mwl" event={"ID":"e1ebe241-4196-4ecf-899b-4680e42bde79","Type":"ContainerStarted","Data":"c3bfd99c3eb24675580a36bb713cdb6164f00f4f1619ed7b1ca63b3ce618a4c8"}
Jul 01 18:10:52.234253 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:52.234220    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:52.438160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:52.438127    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:53.042492 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:53.042463    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:53.112471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:53.112438    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:55.754883 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:55.754850    2555 generic.go:356] "Generic (PLEG): container finished" podID="e96b874c-e65c-4181-b59e-594a1d25a5b9" containerID="7595d150c0a331bc6bbd24e41058d65ef8903b2ef4f8f0f7e903572061f36898" exitCode=0
Jul 01 18:10:55.755279 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:55.754908    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b" event={"ID":"e96b874c-e65c-4181-b59e-594a1d25a5b9","Type":"ContainerDied","Data":"7595d150c0a331bc6bbd24e41058d65ef8903b2ef4f8f0f7e903572061f36898"}
Jul 01 18:10:55.755279 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:55.755246    2555 scope.go:117] "RemoveContainer" containerID="7595d150c0a331bc6bbd24e41058d65ef8903b2ef4f8f0f7e903572061f36898"
Jul 01 18:10:56.760759 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:10:56.760726    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvb9b" event={"ID":"e96b874c-e65c-4181-b59e-594a1d25a5b9","Type":"ContainerStarted","Data":"8f7052891a7de478f4c71980096384281b82f2e68cc703bd5e8fa687b03fe211"}
Jul 01 18:11:01.842974 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:01.842936    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:11:01.847604 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:01.847578    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9d544f8f9-d54mk"
Jul 01 18:11:16.026701 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:16.026662    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:23.821503 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:23.821452    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:11:23.842299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:23.842272    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:11:23.886052 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:23.886026    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 18:11:28.326751 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:28.326712    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:28.387418 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:28.387390    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:28.444416 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:28.444382    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:33.544721 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:33.544617    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:36.471689 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:36.471644    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:36.706823 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:36.706789    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:44.561463 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:44.561420    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:44.843866 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:44.843759    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:45.238612 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:45.238499    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:45.293364 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:45.293333    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:51.737178 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:51.737144    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:51.794856 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:51.794814    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:56.561365 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:56.561324    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8686d9d6b9-jhrhb"]
Jul 01 18:11:56.684488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:56.684460    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:56.784922 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:56.784880    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:57.009372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:57.009287    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:57.061915 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:57.061883    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:57.607678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:57.607647    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:58.430916 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:58.430885    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:58.488472 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:11:58.488422    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:03.753468 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:03.753434    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:03.812020 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:03.811986    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:07.719324 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:07.719287    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:08.044708 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:08.044672    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:08.142242 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:08.142207    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:21.462289 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.462246    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:21.562358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.562306    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:21.581264 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.581227    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8686d9d6b9-jhrhb" podUID="07d8497b-9534-486a-8b26-9edf59166f0f" containerName="console" containerID="cri-o://1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc" gracePeriod=15
Jul 01 18:12:21.822387 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.822358    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:12:21.947817 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.947719    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvldx\" (UniqueName: \"kubernetes.io/projected/07d8497b-9534-486a-8b26-9edf59166f0f-kube-api-access-fvldx\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.947981 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.947843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-oauth-serving-cert\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.947981 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.947891    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-trusted-ca-bundle\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.947981 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.947938    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-console-config\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.947981 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.947969    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-oauth-config\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.948259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.948019    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-serving-cert\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.948259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.948069    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-service-ca\") pod \"07d8497b-9534-486a-8b26-9edf59166f0f\" (UID: \"07d8497b-9534-486a-8b26-9edf59166f0f\") "
Jul 01 18:12:21.948365 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.948310    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:21.948365 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.948341    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:21.948462 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.948356    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-console-config" (OuterVolumeSpecName: "console-config") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:21.948645 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.948622    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:21.950091 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.950055    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:21.950091 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.950069    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:21.950218 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:21.950160    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d8497b-9534-486a-8b26-9edf59166f0f-kube-api-access-fvldx" (OuterVolumeSpecName: "kube-api-access-fvldx") pod "07d8497b-9534-486a-8b26-9edf59166f0f" (UID: "07d8497b-9534-486a-8b26-9edf59166f0f"). InnerVolumeSpecName "kube-api-access-fvldx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:12:22.049636 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049600    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvldx\" (UniqueName: \"kubernetes.io/projected/07d8497b-9534-486a-8b26-9edf59166f0f-kube-api-access-fvldx\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.049636 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049633    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-oauth-serving-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.049636 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049642    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-trusted-ca-bundle\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.049865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049652    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-console-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.049865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049661    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-oauth-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.049865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049669    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07d8497b-9534-486a-8b26-9edf59166f0f-console-serving-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.049865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.049678    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07d8497b-9534-486a-8b26-9edf59166f0f-service-ca\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:12:22.082796 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.082763    2555 generic.go:356] "Generic (PLEG): container finished" podID="07d8497b-9534-486a-8b26-9edf59166f0f" containerID="1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc" exitCode=0
Jul 01 18:12:22.082929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.082808    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8686d9d6b9-jhrhb"
Jul 01 18:12:22.082929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.082844    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8686d9d6b9-jhrhb" event={"ID":"07d8497b-9534-486a-8b26-9edf59166f0f","Type":"ContainerDied","Data":"1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc"}
Jul 01 18:12:22.082929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.082894    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8686d9d6b9-jhrhb" event={"ID":"07d8497b-9534-486a-8b26-9edf59166f0f","Type":"ContainerDied","Data":"2f610016deac074fb3a9cabff0968773c7d765d0d6e52e88f3df64c3dec5f145"}
Jul 01 18:12:22.082929 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.082915    2555 scope.go:117] "RemoveContainer" containerID="1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc"
Jul 01 18:12:22.091923 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.091906    2555 scope.go:117] "RemoveContainer" containerID="1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc"
Jul 01 18:12:22.092176 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:12:22.092158    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc\": container with ID starting with 1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc not found: ID does not exist" containerID="1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc"
Jul 01 18:12:22.092220 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.092184    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc"} err="failed to get container status \"1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc\": rpc error: code = NotFound desc = could not find container \"1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc\": container with ID starting with 1c5fccdcbca1011c9a66d0fad059d8a245125ea51589835684ea0379c25cbadc not found: ID does not exist"
Jul 01 18:12:22.103934 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.103893    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8686d9d6b9-jhrhb"]
Jul 01 18:12:22.107118 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.107097    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8686d9d6b9-jhrhb"]
Jul 01 18:12:22.702582 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:12:22.702550    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07d8497b-9534-486a-8b26-9edf59166f0f" path="/var/lib/kubelet/pods/07d8497b-9534-486a-8b26-9edf59166f0f/volumes"
Jul 01 18:13:11.412387 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:11.412346    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:11.461705 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:11.461674    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:11.740312 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:11.740233    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:11.842736 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:11.842675    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:11.946576 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:11.946517    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:37.241285 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:37.241251    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:43.909039 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:43.909007    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:44.007519 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:13:44.007485    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:02.802060 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:02.802021    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:03.124504 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:03.124426    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:03.242765 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:03.242722    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:03.342668 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:03.342637    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:03.757519 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:03.757470    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:03.865041 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:03.864963    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:03.944824 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:03.944767    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:04.005319 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:04.005273    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:04.106116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:04.106080    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:04.252708 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:04.252671    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:04.453107 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:04.452981    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:04.528094 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:04.528042    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:04.581293 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:04.581253    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:22.106198 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:14:22.106161    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:03.379890 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:03.379792    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:08.406495 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:08.406432    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:08.494539 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:08.494467    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:08.578398 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:08.578364    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:08.640846 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:08.640809    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:08.787741 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:08.787678    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:09.302373 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:09.302317    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:09.403397 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:09.403354    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:26.118564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:26.118508    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:38.690983 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:38.690953    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:15:38.691577 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:38.691319    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:15:38.707470 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:38.707438    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:15:38.707753 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:38.707736    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:15:45.687278 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:15:45.687243    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:07.010971 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:07.010939    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:07.111492 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:07.111431    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:17.089372 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:17.089333    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:17.199266 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:17.199228    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:17.402581 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:17.402490    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:17.501567 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:17.501509    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:18.315037 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:18.314996    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:18.371828 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:18.371795    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:33.538575 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538538    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-9kw45"]
Jul 01 18:16:33.539029 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538821    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d8497b-9534-486a-8b26-9edf59166f0f" containerName="console"
Jul 01 18:16:33.539029 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538832    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d8497b-9534-486a-8b26-9edf59166f0f" containerName="console"
Jul 01 18:16:33.539029 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538851    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerName="console"
Jul 01 18:16:33.539029 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538858    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerName="console"
Jul 01 18:16:33.539029 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538905    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6de5e46-f5dc-4600-8fa5-0c3db85c3ce6" containerName="console"
Jul 01 18:16:33.539029 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.538915    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d8497b-9534-486a-8b26-9edf59166f0f" containerName="console"
Jul 01 18:16:33.541767 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.541751    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.544262 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.544233    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 18:16:33.544393 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.544364    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-w57gl\""
Jul 01 18:16:33.545292 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.545273    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 18:16:33.545387 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.545298    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 18:16:33.549119 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.548886    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9kw45"]
Jul 01 18:16:33.678116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.678074    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2sd5\" (UniqueName: \"kubernetes.io/projected/3dab095d-ed9e-418c-8c40-3f411bbdfe01-kube-api-access-n2sd5\") pod \"s3-init-9kw45\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") " pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.678116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.678119    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dab095d-ed9e-418c-8c40-3f411bbdfe01-model-cache\") pod \"s3-init-9kw45\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") " pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.779179 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.779138    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2sd5\" (UniqueName: \"kubernetes.io/projected/3dab095d-ed9e-418c-8c40-3f411bbdfe01-kube-api-access-n2sd5\") pod \"s3-init-9kw45\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") " pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.779179 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.779183    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dab095d-ed9e-418c-8c40-3f411bbdfe01-model-cache\") pod \"s3-init-9kw45\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") " pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.779503 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.779488    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dab095d-ed9e-418c-8c40-3f411bbdfe01-model-cache\") pod \"s3-init-9kw45\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") " pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.787481 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.787451    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2sd5\" (UniqueName: \"kubernetes.io/projected/3dab095d-ed9e-418c-8c40-3f411bbdfe01-kube-api-access-n2sd5\") pod \"s3-init-9kw45\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") " pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.864329 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.864241    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9kw45"
Jul 01 18:16:33.995941 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:33.995916    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9kw45"]
Jul 01 18:16:33.998662 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:16:33.998634    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dab095d_ed9e_418c_8c40_3f411bbdfe01.slice/crio-4e42883718cde73341d03bc475c3f753203e3672bdd02cac981a02404f66aa5d WatchSource:0}: Error finding container 4e42883718cde73341d03bc475c3f753203e3672bdd02cac981a02404f66aa5d: Status 404 returned error can't find the container with id 4e42883718cde73341d03bc475c3f753203e3672bdd02cac981a02404f66aa5d
Jul 01 18:16:34.000406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:34.000389    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:16:34.006374 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:34.006347    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9kw45" event={"ID":"3dab095d-ed9e-418c-8c40-3f411bbdfe01","Type":"ContainerStarted","Data":"4e42883718cde73341d03bc475c3f753203e3672bdd02cac981a02404f66aa5d"}
Jul 01 18:16:38.026254 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:38.026168    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9kw45" event={"ID":"3dab095d-ed9e-418c-8c40-3f411bbdfe01","Type":"ContainerStarted","Data":"45784c9c1994910b7daaf8d255cd92391a8a44d9dd4c0da564a5dcdd3036a0fb"}
Jul 01 18:16:40.043048 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:40.043016    2555 generic.go:356] "Generic (PLEG): container finished" podID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerID="45784c9c1994910b7daaf8d255cd92391a8a44d9dd4c0da564a5dcdd3036a0fb" exitCode=0
Jul 01 18:16:40.043514 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:40.043093    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9kw45" event={"ID":"3dab095d-ed9e-418c-8c40-3f411bbdfe01","Type":"ContainerDied","Data":"45784c9c1994910b7daaf8d255cd92391a8a44d9dd4c0da564a5dcdd3036a0fb"}
Jul 01 18:16:44.959679 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:44.959654    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 18:16:45.064787 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:45.064755    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9kw45" event={"ID":"3dab095d-ed9e-418c-8c40-3f411bbdfe01","Type":"ContainerStarted","Data":"4dc054e20d1551175131a350b3d31497f590dbe40ee1f2ce5b83b1b19d04645f"}
Jul 01 18:16:45.082182 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:45.082128    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-9kw45" podStartSLOduration=1.863403973 podStartE2EDuration="12.082109522s" totalImagesPullingTime="8.576305758s" totalInitContainerRuntime="1.642399791s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:16:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:16:45.079999757 +0000 UTC m=+667.191575229" watchObservedRunningTime="2026-07-01 18:16:45.082109522 +0000 UTC m=+667.193684994"
Jul 01 18:16:48.306065 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:48.306025    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:48.406156 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:48.406124    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:58.032981 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:58.032943    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:58.136914 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:58.136880    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:58.192227 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:16:58.192195    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:50.313751 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:50.313715    2555 generic.go:356] "Generic (PLEG): container finished" podID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerID="4dc054e20d1551175131a350b3d31497f590dbe40ee1f2ce5b83b1b19d04645f" exitCode=0
Jul 01 18:17:50.314176 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:50.313763    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9kw45" event={"ID":"3dab095d-ed9e-418c-8c40-3f411bbdfe01","Type":"ContainerDied","Data":"4dc054e20d1551175131a350b3d31497f590dbe40ee1f2ce5b83b1b19d04645f"}
Jul 01 18:17:51.440282 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.440258    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9kw45"
Jul 01 18:17:51.480342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.480305    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2sd5\" (UniqueName: \"kubernetes.io/projected/3dab095d-ed9e-418c-8c40-3f411bbdfe01-kube-api-access-n2sd5\") pod \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") "
Jul 01 18:17:51.480501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.480397    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dab095d-ed9e-418c-8c40-3f411bbdfe01-model-cache\") pod \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\" (UID: \"3dab095d-ed9e-418c-8c40-3f411bbdfe01\") "
Jul 01 18:17:51.482553 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.482515    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dab095d-ed9e-418c-8c40-3f411bbdfe01-kube-api-access-n2sd5" (OuterVolumeSpecName: "kube-api-access-n2sd5") pod "3dab095d-ed9e-418c-8c40-3f411bbdfe01" (UID: "3dab095d-ed9e-418c-8c40-3f411bbdfe01"). InnerVolumeSpecName "kube-api-access-n2sd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:17:51.499551 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.499502    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dab095d-ed9e-418c-8c40-3f411bbdfe01-model-cache" (OuterVolumeSpecName: "model-cache") pod "3dab095d-ed9e-418c-8c40-3f411bbdfe01" (UID: "3dab095d-ed9e-418c-8c40-3f411bbdfe01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:17:51.582012 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.581926    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2sd5\" (UniqueName: \"kubernetes.io/projected/3dab095d-ed9e-418c-8c40-3f411bbdfe01-kube-api-access-n2sd5\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:17:51.582012 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:51.581958    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dab095d-ed9e-418c-8c40-3f411bbdfe01-model-cache\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.325760 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:52.325716    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9kw45"
Jul 01 18:17:52.325760 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:52.325735    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9kw45" event={"ID":"3dab095d-ed9e-418c-8c40-3f411bbdfe01","Type":"ContainerDied","Data":"4e42883718cde73341d03bc475c3f753203e3672bdd02cac981a02404f66aa5d"}
Jul 01 18:17:52.325968 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:52.325772    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e42883718cde73341d03bc475c3f753203e3672bdd02cac981a02404f66aa5d"
Jul 01 18:17:53.096173 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.096139    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"]
Jul 01 18:17:53.096565 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.096420    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerName="s3-init"
Jul 01 18:17:53.096565 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.096432    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerName="s3-init"
Jul 01 18:17:53.096565 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.096455    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerName="download-hf-model"
Jul 01 18:17:53.096565 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.096461    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerName="download-hf-model"
Jul 01 18:17:53.096565 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.096508    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dab095d-ed9e-418c-8c40-3f411bbdfe01" containerName="s3-init"
Jul 01 18:17:53.098761 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.098734    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:53.099348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.099333    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.101844 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.101822    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 18:17:53.101960 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.101845    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-w57gl\""
Jul 01 18:17:53.101960 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.101852    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 18:17:53.101960 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.101851    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 01 18:17:53.106819 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.106797    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"]
Jul 01 18:17:53.195540 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.195495    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6hh5\" (UniqueName: \"kubernetes.io/projected/286908d2-4dd5-4db7-8376-429bfe9257fc-kube-api-access-f6hh5\") pod \"seaweedfs-tls-custom-6644bf5d6c-k6wm6\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.195719 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.195563    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/286908d2-4dd5-4db7-8376-429bfe9257fc-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-k6wm6\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.296614 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.296584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6hh5\" (UniqueName: \"kubernetes.io/projected/286908d2-4dd5-4db7-8376-429bfe9257fc-kube-api-access-f6hh5\") pod \"seaweedfs-tls-custom-6644bf5d6c-k6wm6\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.296788 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.296628    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/286908d2-4dd5-4db7-8376-429bfe9257fc-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-k6wm6\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.296983 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.296964    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/286908d2-4dd5-4db7-8376-429bfe9257fc-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-k6wm6\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.305069 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.305050    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6hh5\" (UniqueName: \"kubernetes.io/projected/286908d2-4dd5-4db7-8376-429bfe9257fc-kube-api-access-f6hh5\") pod \"seaweedfs-tls-custom-6644bf5d6c-k6wm6\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.409454 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.409370    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:17:53.537852 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:53.537815    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"]
Jul 01 18:17:53.541108 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:17:53.541078    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286908d2_4dd5_4db7_8376_429bfe9257fc.slice/crio-920ec3a411a3fe48f6791c8980f6e1e1dda0458f103dc13cf4a340ac5e7b69f7 WatchSource:0}: Error finding container 920ec3a411a3fe48f6791c8980f6e1e1dda0458f103dc13cf4a340ac5e7b69f7: Status 404 returned error can't find the container with id 920ec3a411a3fe48f6791c8980f6e1e1dda0458f103dc13cf4a340ac5e7b69f7
Jul 01 18:17:54.334861 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:54.334820    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6" event={"ID":"286908d2-4dd5-4db7-8376-429bfe9257fc","Type":"ContainerStarted","Data":"920ec3a411a3fe48f6791c8980f6e1e1dda0458f103dc13cf4a340ac5e7b69f7"}
Jul 01 18:17:57.347595 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:57.347552    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6" event={"ID":"286908d2-4dd5-4db7-8376-429bfe9257fc","Type":"ContainerStarted","Data":"db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f"}
Jul 01 18:17:57.366507 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:57.366459    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6" podStartSLOduration=0.974144916 podStartE2EDuration="4.366445249s" totalImagesPullingTime="3.392300333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:17:57.365602198 +0000 UTC m=+739.477177674" watchObservedRunningTime="2026-07-01 18:17:57.366445249 +0000 UTC m=+739.478020723"
Jul 01 18:17:59.570133 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:59.570098    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"]
Jul 01 18:17:59.570594 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:17:59.570299    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6" podUID="286908d2-4dd5-4db7-8376-429bfe9257fc" containerName="seaweedfs-tls-custom" containerID="cri-o://db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f" gracePeriod=30
Jul 01 18:18:00.812602 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.812580    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:18:00.864246 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.864174    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6hh5\" (UniqueName: \"kubernetes.io/projected/286908d2-4dd5-4db7-8376-429bfe9257fc-kube-api-access-f6hh5\") pod \"286908d2-4dd5-4db7-8376-429bfe9257fc\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") "
Jul 01 18:18:00.864391 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.864288    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/286908d2-4dd5-4db7-8376-429bfe9257fc-data\") pod \"286908d2-4dd5-4db7-8376-429bfe9257fc\" (UID: \"286908d2-4dd5-4db7-8376-429bfe9257fc\") "
Jul 01 18:18:00.865174 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.865148    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286908d2-4dd5-4db7-8376-429bfe9257fc-data" (OuterVolumeSpecName: "data") pod "286908d2-4dd5-4db7-8376-429bfe9257fc" (UID: "286908d2-4dd5-4db7-8376-429bfe9257fc"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:18:00.866132 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.866111    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286908d2-4dd5-4db7-8376-429bfe9257fc-kube-api-access-f6hh5" (OuterVolumeSpecName: "kube-api-access-f6hh5") pod "286908d2-4dd5-4db7-8376-429bfe9257fc" (UID: "286908d2-4dd5-4db7-8376-429bfe9257fc"). InnerVolumeSpecName "kube-api-access-f6hh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:18:00.964847 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.964807    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6hh5\" (UniqueName: \"kubernetes.io/projected/286908d2-4dd5-4db7-8376-429bfe9257fc-kube-api-access-f6hh5\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:18:00.964847 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:00.964839    2555 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/286908d2-4dd5-4db7-8376-429bfe9257fc-data\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:18:01.365622 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.365589    2555 generic.go:356] "Generic (PLEG): container finished" podID="286908d2-4dd5-4db7-8376-429bfe9257fc" containerID="db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f" exitCode=0
Jul 01 18:18:01.365791 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.365633    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"
Jul 01 18:18:01.365791 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.365658    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6" event={"ID":"286908d2-4dd5-4db7-8376-429bfe9257fc","Type":"ContainerDied","Data":"db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f"}
Jul 01 18:18:01.365791 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.365718    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6" event={"ID":"286908d2-4dd5-4db7-8376-429bfe9257fc","Type":"ContainerDied","Data":"920ec3a411a3fe48f6791c8980f6e1e1dda0458f103dc13cf4a340ac5e7b69f7"}
Jul 01 18:18:01.365791 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.365739    2555 scope.go:117] "RemoveContainer" containerID="db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f"
Jul 01 18:18:01.374778 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.374753    2555 scope.go:117] "RemoveContainer" containerID="db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f"
Jul 01 18:18:01.375023 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:18:01.375003    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f\": container with ID starting with db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f not found: ID does not exist" containerID="db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f"
Jul 01 18:18:01.375089 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.375034    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f"} err="failed to get container status \"db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f\": rpc error: code = NotFound desc = could not find container \"db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f\": container with ID starting with db9dc58938afe7d0c1489d56d87a29c573335600c70490b8398adf4ba22ab66f not found: ID does not exist"
Jul 01 18:18:01.386006 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.385977    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"]
Jul 01 18:18:01.387406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.387382    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-k6wm6"]
Jul 01 18:18:01.416731 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.416702    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"]
Jul 01 18:18:01.417009 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.416994    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286908d2-4dd5-4db7-8376-429bfe9257fc" containerName="seaweedfs-tls-custom"
Jul 01 18:18:01.417064 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.417012    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="286908d2-4dd5-4db7-8376-429bfe9257fc" containerName="seaweedfs-tls-custom"
Jul 01 18:18:01.417099 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.417064    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="286908d2-4dd5-4db7-8376-429bfe9257fc" containerName="seaweedfs-tls-custom"
Jul 01 18:18:01.421193 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.421176    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.423798 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.423752    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 01 18:18:01.423945 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.423802    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\""
Jul 01 18:18:01.423945 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.423825    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 18:18:01.424056 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.423955    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 18:18:01.424767 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.424752    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-w57gl\""
Jul 01 18:18:01.427643 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.427612    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"]
Jul 01 18:18:01.468360 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.468331    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-data\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.468516 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.468390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.468516 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.468419    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flk5w\" (UniqueName: \"kubernetes.io/projected/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-kube-api-access-flk5w\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.569702 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.569655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-data\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.569842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.569730    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.569842 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.569750    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flk5w\" (UniqueName: \"kubernetes.io/projected/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-kube-api-access-flk5w\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.570138 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.570113    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-data\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.572225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.572202    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.578599 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.578577    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flk5w\" (UniqueName: \"kubernetes.io/projected/db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4-kube-api-access-flk5w\") pod \"seaweedfs-tls-custom-8b44d767d-6qdpt\" (UID: \"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.731127 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.731042    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"
Jul 01 18:18:01.861438 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:01.861403    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-6qdpt"]
Jul 01 18:18:01.864302 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:18:01.864266    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2e0ca9_ed1b_4a27_9e34_70b36cadd3e4.slice/crio-000859e572fb9bbab466a25339557f43db0860074b27f4504697d72b36e57644 WatchSource:0}: Error finding container 000859e572fb9bbab466a25339557f43db0860074b27f4504697d72b36e57644: Status 404 returned error can't find the container with id 000859e572fb9bbab466a25339557f43db0860074b27f4504697d72b36e57644
Jul 01 18:18:02.372436 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.372394    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt" event={"ID":"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4","Type":"ContainerStarted","Data":"9d1cdc99233cb37dd50211b151f838930c64a6038e7834a9ee407bc5b6d7e9b3"}
Jul 01 18:18:02.372436 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.372444    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt" event={"ID":"db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4","Type":"ContainerStarted","Data":"000859e572fb9bbab466a25339557f43db0860074b27f4504697d72b36e57644"}
Jul 01 18:18:02.389348 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.389272    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-6qdpt" podStartSLOduration=1.020773797 podStartE2EDuration="1.389256783s" totalImagesPullingTime="368.482986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:18:02.3880653 +0000 UTC m=+744.499640785" watchObservedRunningTime="2026-07-01 18:18:02.389256783 +0000 UTC m=+744.500832255"
Jul 01 18:18:02.702733 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.702699    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286908d2-4dd5-4db7-8376-429bfe9257fc" path="/var/lib/kubelet/pods/286908d2-4dd5-4db7-8376-429bfe9257fc/volumes"
Jul 01 18:18:02.715350 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.715321    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-tkml4"]
Jul 01 18:18:02.718157 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.718142    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:02.726862 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.726834    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-tkml4"]
Jul 01 18:18:02.779753 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.779719    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f04956-ddb1-4c36-a03a-7e9bbd225d64-model-cache\") pod \"s3-tls-init-custom-tkml4\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") " pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:02.779919 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.779771    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62l24\" (UniqueName: \"kubernetes.io/projected/24f04956-ddb1-4c36-a03a-7e9bbd225d64-kube-api-access-62l24\") pod \"s3-tls-init-custom-tkml4\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") " pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:02.880590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.880553    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f04956-ddb1-4c36-a03a-7e9bbd225d64-model-cache\") pod \"s3-tls-init-custom-tkml4\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") " pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:02.880590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.880595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62l24\" (UniqueName: \"kubernetes.io/projected/24f04956-ddb1-4c36-a03a-7e9bbd225d64-kube-api-access-62l24\") pod \"s3-tls-init-custom-tkml4\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") " pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:02.881084 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.880977    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f04956-ddb1-4c36-a03a-7e9bbd225d64-model-cache\") pod \"s3-tls-init-custom-tkml4\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") " pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:02.890319 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:02.890286    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62l24\" (UniqueName: \"kubernetes.io/projected/24f04956-ddb1-4c36-a03a-7e9bbd225d64-kube-api-access-62l24\") pod \"s3-tls-init-custom-tkml4\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") " pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:03.040454 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:03.040418    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:03.171014 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:03.170906    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-tkml4"]
Jul 01 18:18:03.173650 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:18:03.173617    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24f04956_ddb1_4c36_a03a_7e9bbd225d64.slice/crio-e87410db1476e8f5870f9eea6d190d1215cb26131cfeec0af623755f73fe39d8 WatchSource:0}: Error finding container e87410db1476e8f5870f9eea6d190d1215cb26131cfeec0af623755f73fe39d8: Status 404 returned error can't find the container with id e87410db1476e8f5870f9eea6d190d1215cb26131cfeec0af623755f73fe39d8
Jul 01 18:18:03.377610 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:03.377505    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-tkml4" event={"ID":"24f04956-ddb1-4c36-a03a-7e9bbd225d64","Type":"ContainerStarted","Data":"9483f03d686ce288248b25486bb0c1d9321581858e68bbb9414f6df0369f488a"}
Jul 01 18:18:03.377610 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:03.377567    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-tkml4" event={"ID":"24f04956-ddb1-4c36-a03a-7e9bbd225d64","Type":"ContainerStarted","Data":"e87410db1476e8f5870f9eea6d190d1215cb26131cfeec0af623755f73fe39d8"}
Jul 01 18:18:05.386457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:05.386425    2555 generic.go:356] "Generic (PLEG): container finished" podID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerID="9483f03d686ce288248b25486bb0c1d9321581858e68bbb9414f6df0369f488a" exitCode=0
Jul 01 18:18:05.386901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:05.386480    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-tkml4" event={"ID":"24f04956-ddb1-4c36-a03a-7e9bbd225d64","Type":"ContainerDied","Data":"9483f03d686ce288248b25486bb0c1d9321581858e68bbb9414f6df0369f488a"}
Jul 01 18:18:06.392494 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:06.392452    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-tkml4" event={"ID":"24f04956-ddb1-4c36-a03a-7e9bbd225d64","Type":"ContainerStarted","Data":"542f428a20ff2564ac38ccfa76bd8cd458dd74fe2f7bc27485402f41fe4c21ee"}
Jul 01 18:18:06.408869 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:06.408817    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-tkml4" podStartSLOduration=2.7217024690000002 podStartE2EDuration="4.408799842s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.687097373s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:18:06.408682455 +0000 UTC m=+748.520257928" watchObservedRunningTime="2026-07-01 18:18:06.408799842 +0000 UTC m=+748.520375314"
Jul 01 18:18:13.425274 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:13.425235    2555 generic.go:356] "Generic (PLEG): container finished" podID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerID="542f428a20ff2564ac38ccfa76bd8cd458dd74fe2f7bc27485402f41fe4c21ee" exitCode=0
Jul 01 18:18:13.425657 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:13.425281    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-tkml4" event={"ID":"24f04956-ddb1-4c36-a03a-7e9bbd225d64","Type":"ContainerDied","Data":"542f428a20ff2564ac38ccfa76bd8cd458dd74fe2f7bc27485402f41fe4c21ee"}
Jul 01 18:18:14.592059 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.592024    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:14.686508 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.686393    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f04956-ddb1-4c36-a03a-7e9bbd225d64-model-cache\") pod \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") "
Jul 01 18:18:14.686508 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.686473    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62l24\" (UniqueName: \"kubernetes.io/projected/24f04956-ddb1-4c36-a03a-7e9bbd225d64-kube-api-access-62l24\") pod \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\" (UID: \"24f04956-ddb1-4c36-a03a-7e9bbd225d64\") "
Jul 01 18:18:14.688623 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.688582    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f04956-ddb1-4c36-a03a-7e9bbd225d64-kube-api-access-62l24" (OuterVolumeSpecName: "kube-api-access-62l24") pod "24f04956-ddb1-4c36-a03a-7e9bbd225d64" (UID: "24f04956-ddb1-4c36-a03a-7e9bbd225d64"). InnerVolumeSpecName "kube-api-access-62l24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:18:14.704897 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.704867    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f04956-ddb1-4c36-a03a-7e9bbd225d64-model-cache" (OuterVolumeSpecName: "model-cache") pod "24f04956-ddb1-4c36-a03a-7e9bbd225d64" (UID: "24f04956-ddb1-4c36-a03a-7e9bbd225d64"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:18:14.787363 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.787312    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62l24\" (UniqueName: \"kubernetes.io/projected/24f04956-ddb1-4c36-a03a-7e9bbd225d64-kube-api-access-62l24\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:18:14.787363 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:14.787357    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f04956-ddb1-4c36-a03a-7e9bbd225d64-model-cache\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:18:15.434426 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:15.434399    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-tkml4"
Jul 01 18:18:15.434622 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:15.434393    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-tkml4" event={"ID":"24f04956-ddb1-4c36-a03a-7e9bbd225d64","Type":"ContainerDied","Data":"e87410db1476e8f5870f9eea6d190d1215cb26131cfeec0af623755f73fe39d8"}
Jul 01 18:18:15.434622 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:15.434541    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e87410db1476e8f5870f9eea6d190d1215cb26131cfeec0af623755f73fe39d8"
Jul 01 18:18:16.074206 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:16.074168    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:18:16.594833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:16.594799    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:18:21.834519 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.834486    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-rqfmj"]
Jul 01 18:18:21.835009 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.834810    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerName="s3-tls-init-custom"
Jul 01 18:18:21.835009 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.834822    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerName="s3-tls-init-custom"
Jul 01 18:18:21.835009 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.834837    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerName="download-hf-model"
Jul 01 18:18:21.835009 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.834845    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerName="download-hf-model"
Jul 01 18:18:21.835009 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.834899    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f04956-ddb1-4c36-a03a-7e9bbd225d64" containerName="s3-tls-init-custom"
Jul 01 18:18:21.837732 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.837713    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:21.840597 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.840575    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Jul 01 18:18:21.845871 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.845851    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-rqfmj"]
Jul 01 18:18:21.950680 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.950643    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-model-cache\") pod \"s3-tls-init-serving-rqfmj\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") " pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:21.950870 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:21.950716    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qd2\" (UniqueName: \"kubernetes.io/projected/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-kube-api-access-m4qd2\") pod \"s3-tls-init-serving-rqfmj\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") " pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:22.051895 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.051863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qd2\" (UniqueName: \"kubernetes.io/projected/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-kube-api-access-m4qd2\") pod \"s3-tls-init-serving-rqfmj\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") " pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:22.052066 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.051960    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-model-cache\") pod \"s3-tls-init-serving-rqfmj\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") " pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:22.052349 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.052331    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-model-cache\") pod \"s3-tls-init-serving-rqfmj\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") " pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:22.061072 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.061043    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qd2\" (UniqueName: \"kubernetes.io/projected/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-kube-api-access-m4qd2\") pod \"s3-tls-init-serving-rqfmj\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") " pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:22.157717 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.157622    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:22.289736 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.289709    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-rqfmj"]
Jul 01 18:18:22.292163 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:18:22.292136    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc00eb0c9_f2f9_4ebf_82cc_0be1a4570be9.slice/crio-d5ff8b4828777565e1645c4048d6580582346f1f1429e5d816474a6f1cb2d46f WatchSource:0}: Error finding container d5ff8b4828777565e1645c4048d6580582346f1f1429e5d816474a6f1cb2d46f: Status 404 returned error can't find the container with id d5ff8b4828777565e1645c4048d6580582346f1f1429e5d816474a6f1cb2d46f
Jul 01 18:18:22.464395 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.464306    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-rqfmj" event={"ID":"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9","Type":"ContainerStarted","Data":"8185e102efe6d114471eeccbe116e4ba9e713c53d6503db5d3e17633127d16f4"}
Jul 01 18:18:22.464395 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:22.464351    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-rqfmj" event={"ID":"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9","Type":"ContainerStarted","Data":"d5ff8b4828777565e1645c4048d6580582346f1f1429e5d816474a6f1cb2d46f"}
Jul 01 18:18:24.474088 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:24.474056    2555 generic.go:356] "Generic (PLEG): container finished" podID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerID="8185e102efe6d114471eeccbe116e4ba9e713c53d6503db5d3e17633127d16f4" exitCode=0
Jul 01 18:18:24.474455 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:24.474126    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-rqfmj" event={"ID":"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9","Type":"ContainerDied","Data":"8185e102efe6d114471eeccbe116e4ba9e713c53d6503db5d3e17633127d16f4"}
Jul 01 18:18:25.480176 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:25.480141    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-rqfmj" event={"ID":"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9","Type":"ContainerStarted","Data":"49cb739372126e602a518d9e9a10a198b0e252aaf1b1d57c6b68ad2f3e7f7891"}
Jul 01 18:18:25.497023 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:25.496977    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-rqfmj" podStartSLOduration=2.8323711940000003 podStartE2EDuration="4.496962494s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.6645913s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:18:25.496321732 +0000 UTC m=+767.607897206" watchObservedRunningTime="2026-07-01 18:18:25.496962494 +0000 UTC m=+767.608537965"
Jul 01 18:18:31.507937 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:31.507843    2555 generic.go:356] "Generic (PLEG): container finished" podID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerID="49cb739372126e602a518d9e9a10a198b0e252aaf1b1d57c6b68ad2f3e7f7891" exitCode=0
Jul 01 18:18:31.507937 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:31.507884    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-rqfmj" event={"ID":"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9","Type":"ContainerDied","Data":"49cb739372126e602a518d9e9a10a198b0e252aaf1b1d57c6b68ad2f3e7f7891"}
Jul 01 18:18:32.653157 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.653125    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:32.747342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.747304    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4qd2\" (UniqueName: \"kubernetes.io/projected/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-kube-api-access-m4qd2\") pod \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") "
Jul 01 18:18:32.747558 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.747376    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-model-cache\") pod \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\" (UID: \"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9\") "
Jul 01 18:18:32.749449 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.749414    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-kube-api-access-m4qd2" (OuterVolumeSpecName: "kube-api-access-m4qd2") pod "c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" (UID: "c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9"). InnerVolumeSpecName "kube-api-access-m4qd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:18:32.770424 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.770350    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-model-cache" (OuterVolumeSpecName: "model-cache") pod "c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" (UID: "c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:18:32.848656 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.848623    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4qd2\" (UniqueName: \"kubernetes.io/projected/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-kube-api-access-m4qd2\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:18:32.848656 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:32.848651    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9-model-cache\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:18:33.516873 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:33.516840    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-rqfmj" event={"ID":"c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9","Type":"ContainerDied","Data":"d5ff8b4828777565e1645c4048d6580582346f1f1429e5d816474a6f1cb2d46f"}
Jul 01 18:18:33.516873 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:33.516867    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-rqfmj"
Jul 01 18:18:33.516873 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:33.516879    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5ff8b4828777565e1645c4048d6580582346f1f1429e5d816474a6f1cb2d46f"
Jul 01 18:18:33.860007 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:33.859978    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:18:33.961361 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:33.961328    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:18:45.282561 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.282508    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:18:45.343537 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.343499    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"]
Jul 01 18:18:45.343907 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.343888    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerName="download-hf-model"
Jul 01 18:18:45.343991 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.343909    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerName="download-hf-model"
Jul 01 18:18:45.343991 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.343944    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerName="s3-tls-init-serving"
Jul 01 18:18:45.343991 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.343953    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerName="s3-tls-init-serving"
Jul 01 18:18:45.344140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.344115    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9" containerName="s3-tls-init-serving"
Jul 01 18:18:45.348724 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.348703    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.351248 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.351222    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-predictor-serving-cert\""
Jul 01 18:18:45.351514 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.351490    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 18:18:45.351675 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.351657    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 18:18:45.352419 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.352397    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j88rw\""
Jul 01 18:18:45.352534 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.352404    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 18:18:45.352534 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.352404    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-kube-rbac-proxy-sar-config\""
Jul 01 18:18:45.352534 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.352445    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 18:18:45.360069 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.360048    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"]
Jul 01 18:18:45.454226 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.454192    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcx4x\" (UniqueName: \"kubernetes.io/projected/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-api-access-dcx4x\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.454406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.454234    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8977a0ba-61f3-4a73-9364-315bb2cc6a65-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.454406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.454295    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.454406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.454350    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.454406 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.454393    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.460002 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.459975    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:18:45.555040 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555230 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555061    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555230 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555109    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcx4x\" (UniqueName: \"kubernetes.io/projected/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-api-access-dcx4x\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555230 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555140    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8977a0ba-61f3-4a73-9364-315bb2cc6a65-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555230 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555173    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555550 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555500    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555810 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555790    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.555883 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.555854    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.557648 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.557631    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8977a0ba-61f3-4a73-9364-315bb2cc6a65-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.568261 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.563497    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcx4x\" (UniqueName: \"kubernetes.io/projected/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-api-access-dcx4x\") pod \"isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.659093 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.659031    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:18:45.814289 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:45.814264    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"]
Jul 01 18:18:45.816661 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:18:45.816624    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8977a0ba_61f3_4a73_9364_315bb2cc6a65.slice/crio-8b9b8ce4d4329d6867c3c54352c5ffd2e44e2e7c2a301c1bbe0fcf90c6c9bf75 WatchSource:0}: Error finding container 8b9b8ce4d4329d6867c3c54352c5ffd2e44e2e7c2a301c1bbe0fcf90c6c9bf75: Status 404 returned error can't find the container with id 8b9b8ce4d4329d6867c3c54352c5ffd2e44e2e7c2a301c1bbe0fcf90c6c9bf75
Jul 01 18:18:46.569516 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:46.569475    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerStarted","Data":"3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b"}
Jul 01 18:18:46.569891 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:46.569580    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerStarted","Data":"8b9b8ce4d4329d6867c3c54352c5ffd2e44e2e7c2a301c1bbe0fcf90c6c9bf75"}
Jul 01 18:18:50.588681 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:50.588645    2555 generic.go:356] "Generic (PLEG): container finished" podID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerID="3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b" exitCode=0
Jul 01 18:18:50.589049 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:18:50.588719    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerDied","Data":"3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b"}
Jul 01 18:19:06.669874 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:06.669834    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerStarted","Data":"5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e"}
Jul 01 18:19:08.683420 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:08.683384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerStarted","Data":"4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a"}
Jul 01 18:19:11.699996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:11.699961    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerStarted","Data":"1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7"}
Jul 01 18:19:11.700400 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:11.700145    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:19:11.721746 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:11.721683    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podStartSLOduration=2.377460834 podStartE2EDuration="26.721661745s" totalImagesPullingTime="20.493942609s" totalInitContainerRuntime="3.850258302s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:18:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:19:11.719680883 +0000 UTC m=+813.831256356" watchObservedRunningTime="2026-07-01 18:19:11.721661745 +0000 UTC m=+813.833237221"
Jul 01 18:19:12.703396 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:12.703363    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:19:12.703984 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:12.703425    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:19:12.704728 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:12.704695    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:12.705323 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:12.705302    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:19:13.707200 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:13.707156    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:13.707626 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:13.707562    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:19:13.710996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:13.710973    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:19:14.711336 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:14.711296    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:14.711762 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:14.711631    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:19:24.711467 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:24.711415    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:24.711905 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:24.711860    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:19:34.711424 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:34.711385    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:34.711932 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:34.711851    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:19:44.712161 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:44.712116    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:44.712742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:44.712598    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:19:50.976539 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:50.976493    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:54.711585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:54.711547    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:19:54.711999 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:19:54.711976    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:04.711421 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:04.711378    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:20:04.711944 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:04.711920    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:14.711209 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:14.711163    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:20:14.711701 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:14.711657    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:24.712426 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:24.712390    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:20:24.712889 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:24.712492    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:20:30.554769 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.554690    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:20:30.629183 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.629152    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"]
Jul 01 18:20:30.632386 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.632367    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.634673 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.634655    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-predictor-serving-cert\""
Jul 01 18:20:30.634761 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.634657    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-kube-rbac-proxy-sar-config\""
Jul 01 18:20:30.644046 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.644023    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"]
Jul 01 18:20:30.661340 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.661307    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"]
Jul 01 18:20:30.661743 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.661686    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" containerID="cri-o://5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e" gracePeriod=30
Jul 01 18:20:30.662016 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.661716    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" containerID="cri-o://1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7" gracePeriod=30
Jul 01 18:20:30.662123 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.661843    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" containerID="cri-o://4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a" gracePeriod=30
Jul 01 18:20:30.787362 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.787320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/63550692-e449-4ff4-9c47-a03bdd856474-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.787505 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.787379    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.787505 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.787438    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.787603 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.787506    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63550692-e449-4ff4-9c47-a03bdd856474-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.787603 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.787575    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7t8q\" (UniqueName: \"kubernetes.io/projected/63550692-e449-4ff4-9c47-a03bdd856474-kube-api-access-p7t8q\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.888758 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.888660    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/63550692-e449-4ff4-9c47-a03bdd856474-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.888758 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.888710    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.888758 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.888741    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.889037 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.888779    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63550692-e449-4ff4-9c47-a03bdd856474-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.889037 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.888820    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7t8q\" (UniqueName: \"kubernetes.io/projected/63550692-e449-4ff4-9c47-a03bdd856474-kube-api-access-p7t8q\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.889277 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.889252    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63550692-e449-4ff4-9c47-a03bdd856474-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.889600 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.889576    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.889668 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.889576    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.891318 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.891299    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/63550692-e449-4ff4-9c47-a03bdd856474-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.896962 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.896933    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7t8q\" (UniqueName: \"kubernetes.io/projected/63550692-e449-4ff4-9c47-a03bdd856474-kube-api-access-p7t8q\") pod \"isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:30.943013 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:30.942977    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:31.019369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:31.019338    2555 generic.go:356] "Generic (PLEG): container finished" podID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerID="4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a" exitCode=2
Jul 01 18:20:31.019538 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:31.019410    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerDied","Data":"4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a"}
Jul 01 18:20:31.074869 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:31.074848    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"]
Jul 01 18:20:31.077577 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:20:31.077554    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63550692_e449_4ff4_9c47_a03bdd856474.slice/crio-5ed609910742dbb1f94e3c1aa30b97f89aab55fd94cdd04b324add850ea9290d WatchSource:0}: Error finding container 5ed609910742dbb1f94e3c1aa30b97f89aab55fd94cdd04b324add850ea9290d: Status 404 returned error can't find the container with id 5ed609910742dbb1f94e3c1aa30b97f89aab55fd94cdd04b324add850ea9290d
Jul 01 18:20:32.024581 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:32.024546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerStarted","Data":"ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb"}
Jul 01 18:20:32.024979 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:32.024611    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerStarted","Data":"5ed609910742dbb1f94e3c1aa30b97f89aab55fd94cdd04b324add850ea9290d"}
Jul 01 18:20:33.005943 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:33.005906    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:20:33.708002 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:33.707962    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 18:20:34.711189 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:34.711151    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:20:34.711613 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:34.711547    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:35.039020 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:35.038989    2555 generic.go:356] "Generic (PLEG): container finished" podID="63550692-e449-4ff4-9c47-a03bdd856474" containerID="ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb" exitCode=0
Jul 01 18:20:35.039184 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:35.039071    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerDied","Data":"ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb"}
Jul 01 18:20:36.045748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.045716    2555 generic.go:356] "Generic (PLEG): container finished" podID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerID="5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e" exitCode=0
Jul 01 18:20:36.046179 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.045793    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerDied","Data":"5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e"}
Jul 01 18:20:36.048006 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.047979    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerStarted","Data":"a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f"}
Jul 01 18:20:36.048119 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.048042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerStarted","Data":"16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2"}
Jul 01 18:20:36.048119 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.048070    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerStarted","Data":"bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9"}
Jul 01 18:20:36.048293 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.048277    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:36.069424 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:36.069381    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podStartSLOduration=2.577527888 podStartE2EDuration="6.069369324s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.491841436s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:20:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:20:36.068056942 +0000 UTC m=+898.179632414" watchObservedRunningTime="2026-07-01 18:20:36.069369324 +0000 UTC m=+898.180944795"
Jul 01 18:20:37.052109 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:37.052074    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:37.052567 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:37.052140    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:37.053251 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:37.053227    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:20:37.053894 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:37.053866    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:38.056007 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.055968    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:20:38.056470 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.056370    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:38.707457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.707419    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 18:20:38.724692 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.724664    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:20:38.725934 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.725911    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:20:38.734311 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.734293    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:20:38.735225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:38.735205    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:20:43.060961 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:43.060934    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:20:43.061546 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:43.061494    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:20:43.061802 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:43.061775    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:43.707396 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:43.707354    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 18:20:43.707619 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:43.707549    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:20:44.711862 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:44.711824    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:20:44.712300 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:44.712199    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:48.707304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:48.707272    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 18:20:53.061486 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:53.061439    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:20:53.061942 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:53.061914    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:53.707650 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:53.707606    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 18:20:54.711280 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:54.711235    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 18:20:54.711863 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:54.711371    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:20:54.711863 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:54.711585    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:20:54.711863 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:54.711689    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:20:58.708300 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:20:58.708262    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 18:21:00.808433 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.808401    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:21:00.861154 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861123    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcx4x\" (UniqueName: \"kubernetes.io/projected/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-api-access-dcx4x\") pod \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") "
Jul 01 18:21:00.861354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861171    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kserve-provision-location\") pod \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") "
Jul 01 18:21:00.861354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861218    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8977a0ba-61f3-4a73-9364-315bb2cc6a65-proxy-tls\") pod \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") "
Jul 01 18:21:00.861354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861269    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-rbac-proxy-sar-config\") pod \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") "
Jul 01 18:21:00.861354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861309    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-cabundle-cert\") pod \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\" (UID: \"8977a0ba-61f3-4a73-9364-315bb2cc6a65\") "
Jul 01 18:21:00.861625 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861579    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8977a0ba-61f3-4a73-9364-315bb2cc6a65" (UID: "8977a0ba-61f3-4a73-9364-315bb2cc6a65"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:21:00.861793 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861687    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8977a0ba-61f3-4a73-9364-315bb2cc6a65" (UID: "8977a0ba-61f3-4a73-9364-315bb2cc6a65"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:21:00.861864 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.861824    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8977a0ba-61f3-4a73-9364-315bb2cc6a65" (UID: "8977a0ba-61f3-4a73-9364-315bb2cc6a65"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:21:00.863468 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.863447    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-api-access-dcx4x" (OuterVolumeSpecName: "kube-api-access-dcx4x") pod "8977a0ba-61f3-4a73-9364-315bb2cc6a65" (UID: "8977a0ba-61f3-4a73-9364-315bb2cc6a65"). InnerVolumeSpecName "kube-api-access-dcx4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:21:00.863593 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.863491    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8977a0ba-61f3-4a73-9364-315bb2cc6a65-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8977a0ba-61f3-4a73-9364-315bb2cc6a65" (UID: "8977a0ba-61f3-4a73-9364-315bb2cc6a65"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:21:00.962430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.962334    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:21:00.962430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.962366    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8977a0ba-61f3-4a73-9364-315bb2cc6a65-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:21:00.962430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.962380    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:21:00.962430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.962391    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8977a0ba-61f3-4a73-9364-315bb2cc6a65-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:21:00.962430 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:00.962405    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcx4x\" (UniqueName: \"kubernetes.io/projected/8977a0ba-61f3-4a73-9364-315bb2cc6a65-kube-api-access-dcx4x\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:21:01.152695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.152655    2555 generic.go:356] "Generic (PLEG): container finished" podID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerID="1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7" exitCode=0
Jul 01 18:21:01.152884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.152714    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"
Jul 01 18:21:01.152884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.152726    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerDied","Data":"1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7"}
Jul 01 18:21:01.152884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.152805    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb" event={"ID":"8977a0ba-61f3-4a73-9364-315bb2cc6a65","Type":"ContainerDied","Data":"8b9b8ce4d4329d6867c3c54352c5ffd2e44e2e7c2a301c1bbe0fcf90c6c9bf75"}
Jul 01 18:21:01.152884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.152853    2555 scope.go:117] "RemoveContainer" containerID="1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7"
Jul 01 18:21:01.161926 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.161906    2555 scope.go:117] "RemoveContainer" containerID="4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a"
Jul 01 18:21:01.169468 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.169446    2555 scope.go:117] "RemoveContainer" containerID="5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e"
Jul 01 18:21:01.175926 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.175554    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"]
Jul 01 18:21:01.181693 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.181664    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-54dcb69b4c-46mbb"]
Jul 01 18:21:01.184356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.184335    2555 scope.go:117] "RemoveContainer" containerID="3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b"
Jul 01 18:21:01.193633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.193607    2555 scope.go:117] "RemoveContainer" containerID="1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7"
Jul 01 18:21:01.194095 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:21:01.194051    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7\": container with ID starting with 1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7 not found: ID does not exist" containerID="1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7"
Jul 01 18:21:01.194192 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.194131    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7"} err="failed to get container status \"1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7\": rpc error: code = NotFound desc = could not find container \"1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7\": container with ID starting with 1b6579735edebbfa0790c54d4c7e077274746df5f562e8f0182574e07813d3c7 not found: ID does not exist"
Jul 01 18:21:01.194239 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.194209    2555 scope.go:117] "RemoveContainer" containerID="4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a"
Jul 01 18:21:01.194570 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:21:01.194510    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a\": container with ID starting with 4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a not found: ID does not exist" containerID="4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a"
Jul 01 18:21:01.194651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.194581    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a"} err="failed to get container status \"4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a\": rpc error: code = NotFound desc = could not find container \"4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a\": container with ID starting with 4c0642cba55c289f780f276d1b76bf250f73637cbe4ba738506c2979ccf5d07a not found: ID does not exist"
Jul 01 18:21:01.194651 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.194607    2555 scope.go:117] "RemoveContainer" containerID="5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e"
Jul 01 18:21:01.194873 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:21:01.194849    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e\": container with ID starting with 5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e not found: ID does not exist" containerID="5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e"
Jul 01 18:21:01.194969 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.194878    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e"} err="failed to get container status \"5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e\": rpc error: code = NotFound desc = could not find container \"5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e\": container with ID starting with 5cafa9caa9b55b1cca31f043e02435f62ffded697180dab52a93d05933b6117e not found: ID does not exist"
Jul 01 18:21:01.194969 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.194895    2555 scope.go:117] "RemoveContainer" containerID="3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b"
Jul 01 18:21:01.195134 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:21:01.195118    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b\": container with ID starting with 3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b not found: ID does not exist" containerID="3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b"
Jul 01 18:21:01.195172 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:01.195140    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b"} err="failed to get container status \"3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b\": rpc error: code = NotFound desc = could not find container \"3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b\": container with ID starting with 3f56fe08780d2c156334d52bffaebb62ef87ff4b40450f80c144b1d95a76211b not found: ID does not exist"
Jul 01 18:21:02.703205 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:02.703171    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" path="/var/lib/kubelet/pods/8977a0ba-61f3-4a73-9364-315bb2cc6a65/volumes"
Jul 01 18:21:03.061960 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:03.061922    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:21:03.062413 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:03.062388    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:05.209685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:05.209647    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:13.061579 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:13.061536    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:21:13.062072 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:13.062044    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:23.061983 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:23.061944    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:21:23.062399 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:23.062335    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:29.285208 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:29.285170    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:29.498303 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:29.498268    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:33.061786 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:33.061741    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:21:33.062195 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:33.062163    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:43.061434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:43.061392    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:21:43.061950 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:43.061926    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:47.698501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:47.698434    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:21:47.704467 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:47.704433    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:57.698513 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:57.698478    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:21:57.699050 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:21:57.698650    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:22:05.726695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.726661    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:05.771044 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771012    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"]
Jul 01 18:22:05.771331 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771318    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent"
Jul 01 18:22:05.771378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771332    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent"
Jul 01 18:22:05.771378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771344    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="storage-initializer"
Jul 01 18:22:05.771378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771355    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="storage-initializer"
Jul 01 18:22:05.771378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771367    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container"
Jul 01 18:22:05.771378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771373    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container"
Jul 01 18:22:05.771541 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771380    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy"
Jul 01 18:22:05.771541 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771386    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy"
Jul 01 18:22:05.771541 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771429    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kube-rbac-proxy"
Jul 01 18:22:05.771541 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771440    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="agent"
Jul 01 18:22:05.771541 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.771450    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8977a0ba-61f3-4a73-9364-315bb2cc6a65" containerName="kserve-container"
Jul 01 18:22:05.773677 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.773661    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:05.776040 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.776012    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\""
Jul 01 18:22:05.776180 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.776091    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\""
Jul 01 18:22:05.783817 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.783795    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"]
Jul 01 18:22:05.791537 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.791500    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"]
Jul 01 18:22:05.791797 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.791761    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" containerID="cri-o://bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9" gracePeriod=30
Jul 01 18:22:05.791865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.791833    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" containerID="cri-o://a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f" gracePeriod=30
Jul 01 18:22:05.791865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.791851    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" containerID="cri-o://16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2" gracePeriod=30
Jul 01 18:22:05.806420 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.806379    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:05.919427 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.919391    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxljm\" (UniqueName: \"kubernetes.io/projected/dd590e93-550f-41b3-8c34-66f61639da69-kube-api-access-qxljm\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:05.919427 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.919431    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dd590e93-550f-41b3-8c34-66f61639da69-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:05.919647 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.919453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dd590e93-550f-41b3-8c34-66f61639da69-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:05.938305 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:05.938273    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:06.020161 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.020073    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxljm\" (UniqueName: \"kubernetes.io/projected/dd590e93-550f-41b3-8c34-66f61639da69-kube-api-access-qxljm\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.020161 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.020121    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dd590e93-550f-41b3-8c34-66f61639da69-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.020161 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.020151    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dd590e93-550f-41b3-8c34-66f61639da69-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.020903 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.020880    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dd590e93-550f-41b3-8c34-66f61639da69-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.022562 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.022540    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dd590e93-550f-41b3-8c34-66f61639da69-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.027788 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.027766    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxljm\" (UniqueName: \"kubernetes.io/projected/dd590e93-550f-41b3-8c34-66f61639da69-kube-api-access-qxljm\") pod \"message-dumper-predictor-6575bcfdfd-4kl4l\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.084954 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.084915    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:06.212932 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.212900    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"]
Jul 01 18:22:06.214850 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:22:06.214830    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd590e93_550f_41b3_8c34_66f61639da69.slice/crio-f1a41088be57eda221ed7498449460cee45146187e4820cda049e7e91bd8ae37 WatchSource:0}: Error finding container f1a41088be57eda221ed7498449460cee45146187e4820cda049e7e91bd8ae37: Status 404 returned error can't find the container with id f1a41088be57eda221ed7498449460cee45146187e4820cda049e7e91bd8ae37
Jul 01 18:22:06.216695 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.216678    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:22:06.423336 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.423303    2555 generic.go:356] "Generic (PLEG): container finished" podID="63550692-e449-4ff4-9c47-a03bdd856474" containerID="16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2" exitCode=2
Jul 01 18:22:06.423511 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.423376    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerDied","Data":"16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2"}
Jul 01 18:22:06.424458 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:06.424435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" event={"ID":"dd590e93-550f-41b3-8c34-66f61639da69","Type":"ContainerStarted","Data":"f1a41088be57eda221ed7498449460cee45146187e4820cda049e7e91bd8ae37"}
Jul 01 18:22:07.698500 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:07.698400    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:22:07.698890 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:07.698767    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:08.056625 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.056577    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 01 18:22:08.440169 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.440083    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" event={"ID":"dd590e93-550f-41b3-8c34-66f61639da69","Type":"ContainerStarted","Data":"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"}
Jul 01 18:22:08.440321 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.440171    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" event={"ID":"dd590e93-550f-41b3-8c34-66f61639da69","Type":"ContainerStarted","Data":"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"}
Jul 01 18:22:08.440321 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.440197    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:08.440321 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.440242    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:08.441884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.441864    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:08.459954 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:08.459911    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" podStartSLOduration=2.231693265 podStartE2EDuration="3.459894744s" totalImagesPullingTime="1.228201479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:22:08.457504279 +0000 UTC m=+990.569079750" watchObservedRunningTime="2026-07-01 18:22:08.459894744 +0000 UTC m=+990.571470215"
Jul 01 18:22:11.454128 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:11.454097    2555 generic.go:356] "Generic (PLEG): container finished" podID="63550692-e449-4ff4-9c47-a03bdd856474" containerID="bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9" exitCode=0
Jul 01 18:22:11.454491 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:11.454137    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerDied","Data":"bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9"}
Jul 01 18:22:13.056613 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:13.056571    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 01 18:22:15.452347 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.452316    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:22:15.785946 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.785868    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:15.830297 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.830265    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"]
Jul 01 18:22:15.833081 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.833064    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:15.835349 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.835320    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-predictor-serving-cert\""
Jul 01 18:22:15.835349 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.835336    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-kube-rbac-proxy-sar-config\""
Jul 01 18:22:15.846041 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:15.846014    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"]
Jul 01 18:22:16.012191 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.012153    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.012370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.012209    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-cabundle-cert\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.012370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.012285    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g99qg\" (UniqueName: \"kubernetes.io/projected/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-api-access-g99qg\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.012370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.012344    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kserve-provision-location\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.012477 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.012381    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.113219 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.113177    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g99qg\" (UniqueName: \"kubernetes.io/projected/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-api-access-g99qg\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.113398 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.113234    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kserve-provision-location\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.113398 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.113272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.113398 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.113329    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.113398 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.113384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-cabundle-cert\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.113638 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:22:16.113397    2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-logger-predictor-serving-cert: secret "isvc-logger-predictor-serving-cert" not found
Jul 01 18:22:16.113638 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:22:16.113478    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls podName:95c3687d-82e0-47aa-9ec2-ec48ac026a8c nodeName:}" failed. No retries permitted until 2026-07-01 18:22:16.61345719 +0000 UTC m=+998.725032652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls") pod "isvc-logger-predictor-7997fc58c6-pbljd" (UID: "95c3687d-82e0-47aa-9ec2-ec48ac026a8c") : secret "isvc-logger-predictor-serving-cert" not found
Jul 01 18:22:16.113753 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.113689    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kserve-provision-location\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.114121 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.114098    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.114206 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.114148    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-cabundle-cert\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.122901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.122879    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g99qg\" (UniqueName: \"kubernetes.io/projected/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-api-access-g99qg\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.263492 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.263459    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:16.617457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.617420    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.619854 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.619824    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls\") pod \"isvc-logger-predictor-7997fc58c6-pbljd\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.745759 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.745721    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:16.879267 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:16.879245    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"]
Jul 01 18:22:16.881035 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:22:16.881010    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c3687d_82e0_47aa_9ec2_ec48ac026a8c.slice/crio-01ec9e8cb6a680f1eff9498d8700a5377fd7e0bf80cea548a0b5b832b8561692 WatchSource:0}: Error finding container 01ec9e8cb6a680f1eff9498d8700a5377fd7e0bf80cea548a0b5b832b8561692: Status 404 returned error can't find the container with id 01ec9e8cb6a680f1eff9498d8700a5377fd7e0bf80cea548a0b5b832b8561692
Jul 01 18:22:17.482370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:17.482334    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerStarted","Data":"c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f"}
Jul 01 18:22:17.482566 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:17.482402    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerStarted","Data":"01ec9e8cb6a680f1eff9498d8700a5377fd7e0bf80cea548a0b5b832b8561692"}
Jul 01 18:22:17.698803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:17.698757    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:22:17.699227 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:17.699093    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:18.057039 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:18.056990    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 01 18:22:18.057223 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:18.057113    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:22:21.501968 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:21.501931    2555 generic.go:356] "Generic (PLEG): container finished" podID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerID="c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f" exitCode=0
Jul 01 18:22:21.502370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:21.501972    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerDied","Data":"c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f"}
Jul 01 18:22:22.508591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.508557    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerStarted","Data":"a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc"}
Jul 01 18:22:22.508997 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.508624    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerStarted","Data":"a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea"}
Jul 01 18:22:22.508997 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.508650    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerStarted","Data":"e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a"}
Jul 01 18:22:22.508997 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.508924    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:22.509137 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.509065    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:22.510345 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.510318    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:22.533675 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:22.533630    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podStartSLOduration=3.705208732 podStartE2EDuration="7.533618493s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.828409761s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:22:22.53219519 +0000 UTC m=+1004.643770664" watchObservedRunningTime="2026-07-01 18:22:22.533618493 +0000 UTC m=+1004.645193965"
Jul 01 18:22:23.056649 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:23.056608    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 01 18:22:23.515114 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:23.515081    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:23.515593 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:23.515278    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:23.516433 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:23.516405    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:24.519075 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:24.519028    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:24.519555 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:24.519486    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:27.698232 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:27.698196    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:5000: connect: connection refused"
Jul 01 18:22:27.698668 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:27.698332    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:22:27.698668 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:27.698471    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:27.698668 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:27.698583    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:22:28.056453 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:28.056409    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 01 18:22:29.523281 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:29.523251    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:22:29.523901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:29.523872    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:29.524120 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:29.524101    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:33.056720 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:33.056677    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Jul 01 18:22:35.948846 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.948822    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:22:35.979194 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979167    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-cabundle-cert\") pod \"63550692-e449-4ff4-9c47-a03bdd856474\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") "
Jul 01 18:22:35.979358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979234    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63550692-e449-4ff4-9c47-a03bdd856474-kserve-provision-location\") pod \"63550692-e449-4ff4-9c47-a03bdd856474\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") "
Jul 01 18:22:35.979436 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979358    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7t8q\" (UniqueName: \"kubernetes.io/projected/63550692-e449-4ff4-9c47-a03bdd856474-kube-api-access-p7t8q\") pod \"63550692-e449-4ff4-9c47-a03bdd856474\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") "
Jul 01 18:22:35.979495 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979446    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-kube-rbac-proxy-sar-config\") pod \"63550692-e449-4ff4-9c47-a03bdd856474\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") "
Jul 01 18:22:35.979495 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979468    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "63550692-e449-4ff4-9c47-a03bdd856474" (UID: "63550692-e449-4ff4-9c47-a03bdd856474"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:22:35.979608 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979496    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/63550692-e449-4ff4-9c47-a03bdd856474-proxy-tls\") pod \"63550692-e449-4ff4-9c47-a03bdd856474\" (UID: \"63550692-e449-4ff4-9c47-a03bdd856474\") "
Jul 01 18:22:35.979608 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979538    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63550692-e449-4ff4-9c47-a03bdd856474-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "63550692-e449-4ff4-9c47-a03bdd856474" (UID: "63550692-e449-4ff4-9c47-a03bdd856474"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:22:35.979806 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979781    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:22:35.979939 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979814    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63550692-e449-4ff4-9c47-a03bdd856474-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:22:35.979939 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.979780    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "63550692-e449-4ff4-9c47-a03bdd856474" (UID: "63550692-e449-4ff4-9c47-a03bdd856474"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:22:35.981457 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.981429    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63550692-e449-4ff4-9c47-a03bdd856474-kube-api-access-p7t8q" (OuterVolumeSpecName: "kube-api-access-p7t8q") pod "63550692-e449-4ff4-9c47-a03bdd856474" (UID: "63550692-e449-4ff4-9c47-a03bdd856474"). InnerVolumeSpecName "kube-api-access-p7t8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:22:35.981557 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:35.981453    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63550692-e449-4ff4-9c47-a03bdd856474-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "63550692-e449-4ff4-9c47-a03bdd856474" (UID: "63550692-e449-4ff4-9c47-a03bdd856474"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:22:36.080234 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.080146    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/63550692-e449-4ff4-9c47-a03bdd856474-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:22:36.080234 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.080179    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7t8q\" (UniqueName: \"kubernetes.io/projected/63550692-e449-4ff4-9c47-a03bdd856474-kube-api-access-p7t8q\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:22:36.080234 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.080189    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/63550692-e449-4ff4-9c47-a03bdd856474-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:22:36.577601 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.577569    2555 generic.go:356] "Generic (PLEG): container finished" podID="63550692-e449-4ff4-9c47-a03bdd856474" containerID="a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f" exitCode=0
Jul 01 18:22:36.577804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.577638    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"
Jul 01 18:22:36.577804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.577641    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerDied","Data":"a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f"}
Jul 01 18:22:36.577804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.577716    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4" event={"ID":"63550692-e449-4ff4-9c47-a03bdd856474","Type":"ContainerDied","Data":"5ed609910742dbb1f94e3c1aa30b97f89aab55fd94cdd04b324add850ea9290d"}
Jul 01 18:22:36.577804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.577758    2555 scope.go:117] "RemoveContainer" containerID="a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f"
Jul 01 18:22:36.586512 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.586493    2555 scope.go:117] "RemoveContainer" containerID="16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2"
Jul 01 18:22:36.594432 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.594410    2555 scope.go:117] "RemoveContainer" containerID="bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9"
Jul 01 18:22:36.599120 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.599095    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"]
Jul 01 18:22:36.602762 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.602734    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-7fd7b677bb-pvdk4"]
Jul 01 18:22:36.603243 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.603229    2555 scope.go:117] "RemoveContainer" containerID="ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb"
Jul 01 18:22:36.610862 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.610834    2555 scope.go:117] "RemoveContainer" containerID="a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f"
Jul 01 18:22:36.611120 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:22:36.611101    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f\": container with ID starting with a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f not found: ID does not exist" containerID="a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f"
Jul 01 18:22:36.611158 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611129    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f"} err="failed to get container status \"a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f\": rpc error: code = NotFound desc = could not find container \"a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f\": container with ID starting with a1a032d51812aa9b2516fa29214105a91a65e5b8eb02aa1bdc715f7b71852a3f not found: ID does not exist"
Jul 01 18:22:36.611158 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611149    2555 scope.go:117] "RemoveContainer" containerID="16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2"
Jul 01 18:22:36.611381 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:22:36.611366    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2\": container with ID starting with 16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2 not found: ID does not exist" containerID="16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2"
Jul 01 18:22:36.611421 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611385    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2"} err="failed to get container status \"16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2\": rpc error: code = NotFound desc = could not find container \"16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2\": container with ID starting with 16e504732404f30fffea0bacd0004dcf7bcc1733364630c1e00a65f23708a3c2 not found: ID does not exist"
Jul 01 18:22:36.611421 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611397    2555 scope.go:117] "RemoveContainer" containerID="bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9"
Jul 01 18:22:36.611663 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:22:36.611644    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9\": container with ID starting with bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9 not found: ID does not exist" containerID="bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9"
Jul 01 18:22:36.611708 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611669    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9"} err="failed to get container status \"bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9\": rpc error: code = NotFound desc = could not find container \"bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9\": container with ID starting with bdb1252126733537d018c08f6227f9c96b7bd8635b056dc6552257ca06dd4fe9 not found: ID does not exist"
Jul 01 18:22:36.611708 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611694    2555 scope.go:117] "RemoveContainer" containerID="ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb"
Jul 01 18:22:36.611904 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:22:36.611887    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb\": container with ID starting with ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb not found: ID does not exist" containerID="ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb"
Jul 01 18:22:36.611953 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.611911    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb"} err="failed to get container status \"ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb\": rpc error: code = NotFound desc = could not find container \"ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb\": container with ID starting with ee435327eae3549550d3503097668ddadf6292b31abdb35a12f09a68140c0cdb not found: ID does not exist"
Jul 01 18:22:36.702579 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:36.702548    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63550692-e449-4ff4-9c47-a03bdd856474" path="/var/lib/kubelet/pods/63550692-e449-4ff4-9c47-a03bdd856474/volumes"
Jul 01 18:22:39.524694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:39.524646    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:39.525180 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:39.525077    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:49.524396 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:49.524353    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:49.524874 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:49.524797    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:59.524578 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:59.524515    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:22:59.525106 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:22:59.524892    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:23:00.780516 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:00.780476    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:23:00.909654 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:00.909621    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:23:09.524574 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:09.524510    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:23:09.525069 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:09.525003    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:23:19.524027 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:19.523979    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:23:19.524560 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:19.524430    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:23:29.524511 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:29.524412    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:23:29.525059 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:29.524884    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:23:38.702606 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:38.702576    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:23:38.703113 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:38.702669    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:23:50.839659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:50.839629    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-4kl4l_dd590e93-550f-41b3-8c34-66f61639da69/kserve-container/0.log"
Jul 01 18:23:51.058368 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.058339    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:23:51.114095 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.114013    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"]
Jul 01 18:23:51.114358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.114264    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" containerID="cri-o://e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a" gracePeriod=30
Jul 01 18:23:51.114358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.114282    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" containerID="cri-o://a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc" gracePeriod=30
Jul 01 18:23:51.114358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.114337    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" containerID="cri-o://a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea" gracePeriod=30
Jul 01 18:23:51.131926 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.131499    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"]
Jul 01 18:23:51.132303 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132265    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container"
Jul 01 18:23:51.132303 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132295    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container"
Jul 01 18:23:51.132471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132329    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent"
Jul 01 18:23:51.132471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132336    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent"
Jul 01 18:23:51.132471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132349    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="storage-initializer"
Jul 01 18:23:51.132471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132355    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="storage-initializer"
Jul 01 18:23:51.132471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132387    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy"
Jul 01 18:23:51.132471 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132396    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy"
Jul 01 18:23:51.132770 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132517    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kube-rbac-proxy"
Jul 01 18:23:51.132770 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132551    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="agent"
Jul 01 18:23:51.132770 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.132562    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="63550692-e449-4ff4-9c47-a03bdd856474" containerName="kserve-container"
Jul 01 18:23:51.136681 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.136659    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.139804 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.139783    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-predictor-serving-cert\""
Jul 01 18:23:51.140718 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.140682    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-kube-rbac-proxy-sar-config\""
Jul 01 18:23:51.145259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.145236    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"]
Jul 01 18:23:51.148604 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.148560    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:23:51.168954 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.168917    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"]
Jul 01 18:23:51.169212 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.169171    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kserve-container" containerID="cri-o://460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28" gracePeriod=30
Jul 01 18:23:51.169212 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.169198    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kube-rbac-proxy" containerID="cri-o://966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578" gracePeriod=30
Jul 01 18:23:51.212127 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.212094    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:23:51.231267 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.231233    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.231439 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.231275    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.231439 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.231297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.231439 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.231344    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/392cb330-b4f1-4d99-bd5e-9a2d6e172523-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.231439 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.231364    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhlzf\" (UniqueName: \"kubernetes.io/projected/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-api-access-vhlzf\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.332484 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.332447    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.332484 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.332489    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.332748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.332508    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.332748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.332559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/392cb330-b4f1-4d99-bd5e-9a2d6e172523-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.332748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.332578    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhlzf\" (UniqueName: \"kubernetes.io/projected/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-api-access-vhlzf\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.333263 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.332918    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.333328 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.333283    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.333391 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.333373    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.334974 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.334955    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/392cb330-b4f1-4d99-bd5e-9a2d6e172523-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.342922 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.342900    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhlzf\" (UniqueName: \"kubernetes.io/projected/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-api-access-vhlzf\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.407478 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.407452    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:23:51.450931 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.450895    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:23:51.535131 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.535098    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dd590e93-550f-41b3-8c34-66f61639da69-kube-rbac-proxy-sar-config\") pod \"dd590e93-550f-41b3-8c34-66f61639da69\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") "
Jul 01 18:23:51.535287 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.535188    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxljm\" (UniqueName: \"kubernetes.io/projected/dd590e93-550f-41b3-8c34-66f61639da69-kube-api-access-qxljm\") pod \"dd590e93-550f-41b3-8c34-66f61639da69\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") "
Jul 01 18:23:51.535287 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.535257    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dd590e93-550f-41b3-8c34-66f61639da69-proxy-tls\") pod \"dd590e93-550f-41b3-8c34-66f61639da69\" (UID: \"dd590e93-550f-41b3-8c34-66f61639da69\") "
Jul 01 18:23:51.535544 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.535495    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd590e93-550f-41b3-8c34-66f61639da69-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "dd590e93-550f-41b3-8c34-66f61639da69" (UID: "dd590e93-550f-41b3-8c34-66f61639da69"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:23:51.539997 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.539964    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd590e93-550f-41b3-8c34-66f61639da69-kube-api-access-qxljm" (OuterVolumeSpecName: "kube-api-access-qxljm") pod "dd590e93-550f-41b3-8c34-66f61639da69" (UID: "dd590e93-550f-41b3-8c34-66f61639da69"). InnerVolumeSpecName "kube-api-access-qxljm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:23:51.540130 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.539970    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd590e93-550f-41b3-8c34-66f61639da69-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "dd590e93-550f-41b3-8c34-66f61639da69" (UID: "dd590e93-550f-41b3-8c34-66f61639da69"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:23:51.581563 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.581518    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"]
Jul 01 18:23:51.583777 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:23:51.583753    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392cb330_b4f1_4d99_bd5e_9a2d6e172523.slice/crio-4a881b3cd7ce57e9b96e2fc0ced6972a2bc70ebdc60fda12304de12d28e413ff WatchSource:0}: Error finding container 4a881b3cd7ce57e9b96e2fc0ced6972a2bc70ebdc60fda12304de12d28e413ff: Status 404 returned error can't find the container with id 4a881b3cd7ce57e9b96e2fc0ced6972a2bc70ebdc60fda12304de12d28e413ff
Jul 01 18:23:51.636129 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.636106    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxljm\" (UniqueName: \"kubernetes.io/projected/dd590e93-550f-41b3-8c34-66f61639da69-kube-api-access-qxljm\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:23:51.636129 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.636128    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dd590e93-550f-41b3-8c34-66f61639da69-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:23:51.636267 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.636138    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dd590e93-550f-41b3-8c34-66f61639da69-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:23:51.898226 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898184    2555 generic.go:356] "Generic (PLEG): container finished" podID="dd590e93-550f-41b3-8c34-66f61639da69" containerID="966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578" exitCode=2
Jul 01 18:23:51.898226 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898209    2555 generic.go:356] "Generic (PLEG): container finished" podID="dd590e93-550f-41b3-8c34-66f61639da69" containerID="460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28" exitCode=2
Jul 01 18:23:51.898796 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898239    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"
Jul 01 18:23:51.898796 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898245    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" event={"ID":"dd590e93-550f-41b3-8c34-66f61639da69","Type":"ContainerDied","Data":"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"}
Jul 01 18:23:51.898796 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898313    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" event={"ID":"dd590e93-550f-41b3-8c34-66f61639da69","Type":"ContainerDied","Data":"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"}
Jul 01 18:23:51.898796 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898344    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l" event={"ID":"dd590e93-550f-41b3-8c34-66f61639da69","Type":"ContainerDied","Data":"f1a41088be57eda221ed7498449460cee45146187e4820cda049e7e91bd8ae37"}
Jul 01 18:23:51.898796 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.898384    2555 scope.go:117] "RemoveContainer" containerID="966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"
Jul 01 18:23:51.901168 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.901141    2555 generic.go:356] "Generic (PLEG): container finished" podID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerID="a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea" exitCode=2
Jul 01 18:23:51.901262 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.901210    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerDied","Data":"a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea"}
Jul 01 18:23:51.902950 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.902922    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerStarted","Data":"312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76"}
Jul 01 18:23:51.903082 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.902981    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerStarted","Data":"4a881b3cd7ce57e9b96e2fc0ced6972a2bc70ebdc60fda12304de12d28e413ff"}
Jul 01 18:23:51.910453 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.910406    2555 scope.go:117] "RemoveContainer" containerID="460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"
Jul 01 18:23:51.918781 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.918761    2555 scope.go:117] "RemoveContainer" containerID="966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"
Jul 01 18:23:51.919062 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:23:51.919044    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578\": container with ID starting with 966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578 not found: ID does not exist" containerID="966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"
Jul 01 18:23:51.919135 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919074    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"} err="failed to get container status \"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578\": rpc error: code = NotFound desc = could not find container \"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578\": container with ID starting with 966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578 not found: ID does not exist"
Jul 01 18:23:51.919135 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919098    2555 scope.go:117] "RemoveContainer" containerID="460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"
Jul 01 18:23:51.919315 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:23:51.919299    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28\": container with ID starting with 460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28 not found: ID does not exist" containerID="460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"
Jul 01 18:23:51.919379 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919321    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"} err="failed to get container status \"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28\": rpc error: code = NotFound desc = could not find container \"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28\": container with ID starting with 460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28 not found: ID does not exist"
Jul 01 18:23:51.919379 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919341    2555 scope.go:117] "RemoveContainer" containerID="966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"
Jul 01 18:23:51.919576 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919558    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578"} err="failed to get container status \"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578\": rpc error: code = NotFound desc = could not find container \"966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578\": container with ID starting with 966845cb8a397001814a97ef014404b2265875432e5f7558ff33a9577c556578 not found: ID does not exist"
Jul 01 18:23:51.919649 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919577    2555 scope.go:117] "RemoveContainer" containerID="460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"
Jul 01 18:23:51.919820 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.919800    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28"} err="failed to get container status \"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28\": rpc error: code = NotFound desc = could not find container \"460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28\": container with ID starting with 460b0f2d72e67d6efe35688475014016ccac550ed389e7fe05f6a30378da6d28 not found: ID does not exist"
Jul 01 18:23:51.934215 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.934190    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"]
Jul 01 18:23:51.938077 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:51.938047    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-4kl4l"]
Jul 01 18:23:52.702742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:52.702710    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd590e93-550f-41b3-8c34-66f61639da69" path="/var/lib/kubelet/pods/dd590e93-550f-41b3-8c34-66f61639da69/volumes"
Jul 01 18:23:54.519627 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:54.519586    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 18:23:55.923991 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:55.923901    2555 generic.go:356] "Generic (PLEG): container finished" podID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerID="e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a" exitCode=0
Jul 01 18:23:55.923991 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:55.923975    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerDied","Data":"e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a"}
Jul 01 18:23:58.700220 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:58.700172    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:23:58.700684 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:58.700564    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:23:59.520024 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:23:59.519985    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 18:24:04.520108 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:04.520058    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 18:24:04.520619 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:04.520199    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:24:08.701038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:08.700988    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:24:08.701907 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:08.701874    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:24:09.520096 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:09.520053    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 18:24:13.003248 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:13.003213    2555 generic.go:356] "Generic (PLEG): container finished" podID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerID="312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76" exitCode=0
Jul 01 18:24:13.003664 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:13.003270    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerDied","Data":"312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76"}
Jul 01 18:24:14.519308 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:14.519248    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 18:24:18.700265 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:18.700088    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 18:24:18.700779 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:18.700559    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:24:18.704922 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:18.704897    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:24:18.705071 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:18.704993    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:24:19.519827 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:19.519782    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 18:24:21.283370 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.283341    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:24:21.387677 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.387578    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g99qg\" (UniqueName: \"kubernetes.io/projected/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-api-access-g99qg\") pod \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") "
Jul 01 18:24:21.387677 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.387635    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-rbac-proxy-sar-config\") pod \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") "
Jul 01 18:24:21.387677 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.387651    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-cabundle-cert\") pod \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") "
Jul 01 18:24:21.387967 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.387713    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kserve-provision-location\") pod \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") "
Jul 01 18:24:21.387967 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.387754    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls\") pod \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\" (UID: \"95c3687d-82e0-47aa-9ec2-ec48ac026a8c\") "
Jul 01 18:24:21.388094 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.388064    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "95c3687d-82e0-47aa-9ec2-ec48ac026a8c" (UID: "95c3687d-82e0-47aa-9ec2-ec48ac026a8c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:24:21.388146 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.388090    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "95c3687d-82e0-47aa-9ec2-ec48ac026a8c" (UID: "95c3687d-82e0-47aa-9ec2-ec48ac026a8c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:24:21.388146 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.388098    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "95c3687d-82e0-47aa-9ec2-ec48ac026a8c" (UID: "95c3687d-82e0-47aa-9ec2-ec48ac026a8c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:24:21.389833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.389801    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "95c3687d-82e0-47aa-9ec2-ec48ac026a8c" (UID: "95c3687d-82e0-47aa-9ec2-ec48ac026a8c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:24:21.389935 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.389861    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-api-access-g99qg" (OuterVolumeSpecName: "kube-api-access-g99qg") pod "95c3687d-82e0-47aa-9ec2-ec48ac026a8c" (UID: "95c3687d-82e0-47aa-9ec2-ec48ac026a8c"). InnerVolumeSpecName "kube-api-access-g99qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:24:21.488616 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.488577    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:24:21.488616 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.488609    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:24:21.488616 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.488620    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g99qg\" (UniqueName: \"kubernetes.io/projected/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-api-access-g99qg\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:24:21.488616 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.488628    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:24:21.488886 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:21.488637    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/95c3687d-82e0-47aa-9ec2-ec48ac026a8c-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:24:22.051992 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.051956    2555 generic.go:356] "Generic (PLEG): container finished" podID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerID="a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc" exitCode=0
Jul 01 18:24:22.052266 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.052014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerDied","Data":"a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc"}
Jul 01 18:24:22.052266 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.052021    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"
Jul 01 18:24:22.052266 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.052069    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd" event={"ID":"95c3687d-82e0-47aa-9ec2-ec48ac026a8c","Type":"ContainerDied","Data":"01ec9e8cb6a680f1eff9498d8700a5377fd7e0bf80cea548a0b5b832b8561692"}
Jul 01 18:24:22.052266 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.052108    2555 scope.go:117] "RemoveContainer" containerID="a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc"
Jul 01 18:24:22.062470 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.062439    2555 scope.go:117] "RemoveContainer" containerID="a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea"
Jul 01 18:24:22.072748 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.072722    2555 scope.go:117] "RemoveContainer" containerID="e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a"
Jul 01 18:24:22.078898 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.078871    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"]
Jul 01 18:24:22.081044 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.081022    2555 scope.go:117] "RemoveContainer" containerID="c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f"
Jul 01 18:24:22.083972 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.083951    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-7997fc58c6-pbljd"]
Jul 01 18:24:22.088700 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.088679    2555 scope.go:117] "RemoveContainer" containerID="a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc"
Jul 01 18:24:22.088979 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:24:22.088959    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc\": container with ID starting with a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc not found: ID does not exist" containerID="a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc"
Jul 01 18:24:22.089116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.088992    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc"} err="failed to get container status \"a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc\": rpc error: code = NotFound desc = could not find container \"a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc\": container with ID starting with a0698b5ca2a1b1453873cae4a53febea85f44d3fe22f310b767e9977d448e3fc not found: ID does not exist"
Jul 01 18:24:22.089116 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.089021    2555 scope.go:117] "RemoveContainer" containerID="a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea"
Jul 01 18:24:22.089295 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:24:22.089277    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea\": container with ID starting with a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea not found: ID does not exist" containerID="a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea"
Jul 01 18:24:22.089340 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.089302    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea"} err="failed to get container status \"a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea\": rpc error: code = NotFound desc = could not find container \"a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea\": container with ID starting with a8c2187731c3485a94c0b44b1bc186d4290c4225d194d5836f960c86f830ccea not found: ID does not exist"
Jul 01 18:24:22.089340 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.089318    2555 scope.go:117] "RemoveContainer" containerID="e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a"
Jul 01 18:24:22.089575 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:24:22.089554    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a\": container with ID starting with e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a not found: ID does not exist" containerID="e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a"
Jul 01 18:24:22.089633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.089583    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a"} err="failed to get container status \"e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a\": rpc error: code = NotFound desc = could not find container \"e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a\": container with ID starting with e0a59a27c6013e42d1f5582da4068fc42698bbfae4f2bf966e3dcc95fc931b0a not found: ID does not exist"
Jul 01 18:24:22.089633 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.089600    2555 scope.go:117] "RemoveContainer" containerID="c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f"
Jul 01 18:24:22.089840 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:24:22.089818    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f\": container with ID starting with c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f not found: ID does not exist" containerID="c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f"
Jul 01 18:24:22.089884 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.089846    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f"} err="failed to get container status \"c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f\": rpc error: code = NotFound desc = could not find container \"c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f\": container with ID starting with c75ced5490774450cde0d49f7a304f687ec12c0bdf71bbd3a6abf85b2269a00f not found: ID does not exist"
Jul 01 18:24:22.703103 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:24:22.703074    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" path="/var/lib/kubelet/pods/95c3687d-82e0-47aa-9ec2-ec48ac026a8c/volumes"
Jul 01 18:25:38.752580 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:25:38.752547    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:25:38.755489 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:25:38.755460    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:25:38.765148 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:25:38.765124    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:25:38.767483 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:25:38.767462    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:26:36.679745 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:36.679709    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerStarted","Data":"7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d"}
Jul 01 18:26:36.680328 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:36.679778    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerStarted","Data":"4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b"}
Jul 01 18:26:36.680328 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:36.679813    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:26:36.680328 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:36.679845    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:26:36.681214 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:36.681186    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 18:26:36.703170 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:36.703119    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" podStartSLOduration=2.230907441 podStartE2EDuration="2m45.703104214s" totalImagesPullingTime="2m22.945421504s" totalInitContainerRuntime="20.526775269s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:26:36.70205188 +0000 UTC m=+1258.813627369" watchObservedRunningTime="2026-07-01 18:26:36.703104214 +0000 UTC m=+1258.814679686"
Jul 01 18:26:37.684877 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:37.684833    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 18:26:42.689494 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:42.689456    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:26:42.690067 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:42.690040    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 18:26:52.690709 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:26:52.690677    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:27:01.317751 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:01.317720    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"]
Jul 01 18:27:01.318125 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:01.317994    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container" containerID="cri-o://4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b" gracePeriod=30
Jul 01 18:27:01.318125 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:01.318056    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kube-rbac-proxy" containerID="cri-o://7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d" gracePeriod=30
Jul 01 18:27:01.369290 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:01.369245    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:27:01.791131 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:01.791099    2555 generic.go:356] "Generic (PLEG): container finished" podID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerID="7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d" exitCode=2
Jul 01 18:27:01.791295 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:01.791141    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerDied","Data":"7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d"}
Jul 01 18:27:02.290380 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.290347    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:27:02.446115 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446020    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhlzf\" (UniqueName: \"kubernetes.io/projected/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-api-access-vhlzf\") pod \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") "
Jul 01 18:27:02.446115 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446104    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kserve-provision-location\") pod \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") "
Jul 01 18:27:02.446676 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446127    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-rbac-proxy-sar-config\") pod \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") "
Jul 01 18:27:02.446676 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446158    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-cabundle-cert\") pod \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") "
Jul 01 18:27:02.446676 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446178    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/392cb330-b4f1-4d99-bd5e-9a2d6e172523-proxy-tls\") pod \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\" (UID: \"392cb330-b4f1-4d99-bd5e-9a2d6e172523\") "
Jul 01 18:27:02.446676 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446503    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "392cb330-b4f1-4d99-bd5e-9a2d6e172523" (UID: "392cb330-b4f1-4d99-bd5e-9a2d6e172523"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:27:02.446676 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.446549    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "392cb330-b4f1-4d99-bd5e-9a2d6e172523" (UID: "392cb330-b4f1-4d99-bd5e-9a2d6e172523"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:27:02.448271 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.448236    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-api-access-vhlzf" (OuterVolumeSpecName: "kube-api-access-vhlzf") pod "392cb330-b4f1-4d99-bd5e-9a2d6e172523" (UID: "392cb330-b4f1-4d99-bd5e-9a2d6e172523"). InnerVolumeSpecName "kube-api-access-vhlzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:27:02.448369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.448301    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/392cb330-b4f1-4d99-bd5e-9a2d6e172523-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "392cb330-b4f1-4d99-bd5e-9a2d6e172523" (UID: "392cb330-b4f1-4d99-bd5e-9a2d6e172523"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:27:02.450993 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.450969    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "392cb330-b4f1-4d99-bd5e-9a2d6e172523" (UID: "392cb330-b4f1-4d99-bd5e-9a2d6e172523"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:27:02.547848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.547810    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:27:02.547848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.547844    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:27:02.547848 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.547855    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/392cb330-b4f1-4d99-bd5e-9a2d6e172523-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:27:02.548096 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.547868    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/392cb330-b4f1-4d99-bd5e-9a2d6e172523-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:27:02.548096 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.547877    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhlzf\" (UniqueName: \"kubernetes.io/projected/392cb330-b4f1-4d99-bd5e-9a2d6e172523-kube-api-access-vhlzf\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:27:02.797814 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.797785    2555 generic.go:356] "Generic (PLEG): container finished" podID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerID="4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b" exitCode=0
Jul 01 18:27:02.797987 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.797838    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"
Jul 01 18:27:02.797987 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.797872    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerDied","Data":"4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b"}
Jul 01 18:27:02.797987 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.797931    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr" event={"ID":"392cb330-b4f1-4d99-bd5e-9a2d6e172523","Type":"ContainerDied","Data":"4a881b3cd7ce57e9b96e2fc0ced6972a2bc70ebdc60fda12304de12d28e413ff"}
Jul 01 18:27:02.797987 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.797959    2555 scope.go:117] "RemoveContainer" containerID="7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d"
Jul 01 18:27:02.806358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.806336    2555 scope.go:117] "RemoveContainer" containerID="4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b"
Jul 01 18:27:02.814062 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.814043    2555 scope.go:117] "RemoveContainer" containerID="312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76"
Jul 01 18:27:02.820185 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.820159    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"]
Jul 01 18:27:02.822427 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.822392    2555 scope.go:117] "RemoveContainer" containerID="7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d"
Jul 01 18:27:02.823327 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:27:02.823303    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d\": container with ID starting with 7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d not found: ID does not exist" containerID="7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d"
Jul 01 18:27:02.823429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.823333    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d"} err="failed to get container status \"7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d\": rpc error: code = NotFound desc = could not find container \"7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d\": container with ID starting with 7d848b0f7a3c500c4cfb1571c230cefdf7d2b95a9b0ea5b24c54198930e1541d not found: ID does not exist"
Jul 01 18:27:02.823429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.823352    2555 scope.go:117] "RemoveContainer" containerID="4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b"
Jul 01 18:27:02.823748 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:27:02.823726    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b\": container with ID starting with 4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b not found: ID does not exist" containerID="4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b"
Jul 01 18:27:02.823834 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.823757    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b"} err="failed to get container status \"4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b\": rpc error: code = NotFound desc = could not find container \"4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b\": container with ID starting with 4837337003f2d64690368052cd491e6dae74f9adf061e3ef672da8582d55e10b not found: ID does not exist"
Jul 01 18:27:02.823834 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.823780    2555 scope.go:117] "RemoveContainer" containerID="312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76"
Jul 01 18:27:02.824085 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:27:02.824060    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76\": container with ID starting with 312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76 not found: ID does not exist" containerID="312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76"
Jul 01 18:27:02.824161 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.824126    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76"} err="failed to get container status \"312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76\": rpc error: code = NotFound desc = could not find container \"312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76\": container with ID starting with 312bde72eca6d362c38a8a241b77742a8f66812d144c3492ab96ff1043656e76 not found: ID does not exist"
Jul 01 18:27:02.824771 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.824753    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-nfvrr"]
Jul 01 18:27:02.965830 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:02.965716    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:27:04.702591 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:04.702555    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" path="/var/lib/kubelet/pods/392cb330-b4f1-4d99-bd5e-9a2d6e172523/volumes"
Jul 01 18:27:06.560304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.560269    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:27:06.619904 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.619866    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"]
Jul 01 18:27:06.620225 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620208    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620228    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620247    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620256    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620270    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620279    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620292    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="storage-initializer"
Jul 01 18:27:06.620304 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620303    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="storage-initializer"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620318    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="storage-initializer"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620326    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="storage-initializer"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620343    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kserve-container"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620352    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kserve-container"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620364    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620372    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620383    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620391    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620400    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620407    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620481    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620493    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kserve-container"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620502    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd590e93-550f-41b3-8c34-66f61639da69" containerName="kserve-container"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620513    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620538    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kserve-container"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620546    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="392cb330-b4f1-4d99-bd5e-9a2d6e172523" containerName="kube-rbac-proxy"
Jul 01 18:27:06.620696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.620554    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c3687d-82e0-47aa-9ec2-ec48ac026a8c" containerName="agent"
Jul 01 18:27:06.646520 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.646485    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"]
Jul 01 18:27:06.646676 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.646627    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.649098 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.649073    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 18:27:06.649217 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.649075    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j88rw\""
Jul 01 18:27:06.650135 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.650092    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 18:27:06.650135 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.650130    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-kube-rbac-proxy-sar-config\""
Jul 01 18:27:06.650311 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.650172    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-predictor-serving-cert\""
Jul 01 18:27:06.650311 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.650175    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 18:27:06.650311 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.650174    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 18:27:06.680678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.680651    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/364a1a1d-258d-4be1-b115-ec85f0e0502e-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.680810 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.680705    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/364a1a1d-258d-4be1-b115-ec85f0e0502e-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.680810 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.680757    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.680810 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.680785    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprsj\" (UniqueName: \"kubernetes.io/projected/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-api-access-tprsj\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.680916 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.680809    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.715050 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.715024    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:27:06.781418 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.781387    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.781590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.781424    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprsj\" (UniqueName: \"kubernetes.io/projected/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-api-access-tprsj\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.781590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.781454    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.781590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.781502    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/364a1a1d-258d-4be1-b115-ec85f0e0502e-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.781590 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.781584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/364a1a1d-258d-4be1-b115-ec85f0e0502e-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.781970 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.781946    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/364a1a1d-258d-4be1-b115-ec85f0e0502e-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.782104 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.782085    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.782188 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.782170    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.784054 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.784032    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/364a1a1d-258d-4be1-b115-ec85f0e0502e-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.789955 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.789933    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprsj\" (UniqueName: \"kubernetes.io/projected/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-api-access-tprsj\") pod \"isvc-autogluon-v2-predictor-67b849d456-shssg\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:06.956544 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:06.956437    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:07.113287 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:07.113251    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"]
Jul 01 18:27:07.115479 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:27:07.115448    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364a1a1d_258d_4be1_b115_ec85f0e0502e.slice/crio-2fbc970edc2bf92609055fd239177cfa314468b821335175eaf3a9aa54e9f6e6 WatchSource:0}: Error finding container 2fbc970edc2bf92609055fd239177cfa314468b821335175eaf3a9aa54e9f6e6: Status 404 returned error can't find the container with id 2fbc970edc2bf92609055fd239177cfa314468b821335175eaf3a9aa54e9f6e6
Jul 01 18:27:07.820198 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:07.820162    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerStarted","Data":"6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839"}
Jul 01 18:27:07.820602 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:07.820220    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerStarted","Data":"2fbc970edc2bf92609055fd239177cfa314468b821335175eaf3a9aa54e9f6e6"}
Jul 01 18:27:27.903226 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:27.903191    2555 generic.go:356] "Generic (PLEG): container finished" podID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerID="6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839" exitCode=0
Jul 01 18:27:27.903646 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:27.903266    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerDied","Data":"6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839"}
Jul 01 18:27:28.910199 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:28.910151    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerStarted","Data":"ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183"}
Jul 01 18:27:28.910703 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:28.910222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerStarted","Data":"cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918"}
Jul 01 18:27:28.910703 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:28.910396    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:28.930217 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:28.930169    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" podStartSLOduration=3.215050065 podStartE2EDuration="22.930153349s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.715103284s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:28.928793488 +0000 UTC m=+1311.040368960" watchObservedRunningTime="2026-07-01 18:27:28.930153349 +0000 UTC m=+1311.041728820"
Jul 01 18:27:29.914833 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:29.914800    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:27:35.924649 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:27:35.924618    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:29:00.659831 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:00.659792    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:29:04.706762 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:04.706723    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:29:06.768543 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:06.768494    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"]
Jul 01 18:29:06.768961 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:06.768747    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kserve-container" containerID="cri-o://cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918" gracePeriod=30
Jul 01 18:29:06.768961 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:06.768781    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kube-rbac-proxy" containerID="cri-o://ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183" gracePeriod=30
Jul 01 18:29:06.793775 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:06.793731    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:29:07.317147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.317111    2555 generic.go:356] "Generic (PLEG): container finished" podID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerID="ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183" exitCode=2
Jul 01 18:29:07.317320 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.317184    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerDied","Data":"ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183"}
Jul 01 18:29:07.720509 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.720481    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:29:07.797579 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.797515    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-cabundle-cert\") pod \"364a1a1d-258d-4be1-b115-ec85f0e0502e\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") "
Jul 01 18:29:07.797996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.797616    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/364a1a1d-258d-4be1-b115-ec85f0e0502e-kserve-provision-location\") pod \"364a1a1d-258d-4be1-b115-ec85f0e0502e\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") "
Jul 01 18:29:07.797996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.797650    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-rbac-proxy-sar-config\") pod \"364a1a1d-258d-4be1-b115-ec85f0e0502e\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") "
Jul 01 18:29:07.797996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.797676    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tprsj\" (UniqueName: \"kubernetes.io/projected/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-api-access-tprsj\") pod \"364a1a1d-258d-4be1-b115-ec85f0e0502e\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") "
Jul 01 18:29:07.797996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.797810    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/364a1a1d-258d-4be1-b115-ec85f0e0502e-proxy-tls\") pod \"364a1a1d-258d-4be1-b115-ec85f0e0502e\" (UID: \"364a1a1d-258d-4be1-b115-ec85f0e0502e\") "
Jul 01 18:29:07.797996 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.797968    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "364a1a1d-258d-4be1-b115-ec85f0e0502e" (UID: "364a1a1d-258d-4be1-b115-ec85f0e0502e"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:29:07.798253 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.798032    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "364a1a1d-258d-4be1-b115-ec85f0e0502e" (UID: "364a1a1d-258d-4be1-b115-ec85f0e0502e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:29:07.798253 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.798124    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:29:07.798253 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.798136    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:29:07.799875 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.799844    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-api-access-tprsj" (OuterVolumeSpecName: "kube-api-access-tprsj") pod "364a1a1d-258d-4be1-b115-ec85f0e0502e" (UID: "364a1a1d-258d-4be1-b115-ec85f0e0502e"). InnerVolumeSpecName "kube-api-access-tprsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:29:07.799993 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.799923    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/364a1a1d-258d-4be1-b115-ec85f0e0502e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "364a1a1d-258d-4be1-b115-ec85f0e0502e" (UID: "364a1a1d-258d-4be1-b115-ec85f0e0502e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:29:07.804256 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.804232    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364a1a1d-258d-4be1-b115-ec85f0e0502e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "364a1a1d-258d-4be1-b115-ec85f0e0502e" (UID: "364a1a1d-258d-4be1-b115-ec85f0e0502e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:29:07.898592 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.898489    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/364a1a1d-258d-4be1-b115-ec85f0e0502e-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:29:07.898592 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.898546    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/364a1a1d-258d-4be1-b115-ec85f0e0502e-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:29:07.898592 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:07.898558    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tprsj\" (UniqueName: \"kubernetes.io/projected/364a1a1d-258d-4be1-b115-ec85f0e0502e-kube-api-access-tprsj\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:29:08.323980 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.323947    2555 generic.go:356] "Generic (PLEG): container finished" podID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerID="cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918" exitCode=0
Jul 01 18:29:08.324140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.324011    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"
Jul 01 18:29:08.324140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.324012    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerDied","Data":"cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918"}
Jul 01 18:29:08.324140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.324134    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg" event={"ID":"364a1a1d-258d-4be1-b115-ec85f0e0502e","Type":"ContainerDied","Data":"2fbc970edc2bf92609055fd239177cfa314468b821335175eaf3a9aa54e9f6e6"}
Jul 01 18:29:08.324245 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.324160    2555 scope.go:117] "RemoveContainer" containerID="ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183"
Jul 01 18:29:08.332656 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.332632    2555 scope.go:117] "RemoveContainer" containerID="cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918"
Jul 01 18:29:08.341344 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.341323    2555 scope.go:117] "RemoveContainer" containerID="6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839"
Jul 01 18:29:08.344778 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.344757    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"]
Jul 01 18:29:08.349445 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.349376    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-shssg"]
Jul 01 18:29:08.350871 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.350847    2555 scope.go:117] "RemoveContainer" containerID="ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183"
Jul 01 18:29:08.351396 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:29:08.351353    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183\": container with ID starting with ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183 not found: ID does not exist" containerID="ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183"
Jul 01 18:29:08.351489 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.351408    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183"} err="failed to get container status \"ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183\": rpc error: code = NotFound desc = could not find container \"ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183\": container with ID starting with ec58ca3243609daccb897f51238c057a0b3a7fd4e4b0238376ae45d250a80183 not found: ID does not exist"
Jul 01 18:29:08.351489 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.351436    2555 scope.go:117] "RemoveContainer" containerID="cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918"
Jul 01 18:29:08.351835 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:29:08.351806    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918\": container with ID starting with cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918 not found: ID does not exist" containerID="cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918"
Jul 01 18:29:08.351889 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.351847    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918"} err="failed to get container status \"cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918\": rpc error: code = NotFound desc = could not find container \"cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918\": container with ID starting with cf21f5f753d883fa2c3828dc0b68c70a132e16d67695af07c718c7c5d4186918 not found: ID does not exist"
Jul 01 18:29:08.351889 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.351871    2555 scope.go:117] "RemoveContainer" containerID="6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839"
Jul 01 18:29:08.352162 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:29:08.352142    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839\": container with ID starting with 6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839 not found: ID does not exist" containerID="6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839"
Jul 01 18:29:08.352218 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.352169    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839"} err="failed to get container status \"6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839\": rpc error: code = NotFound desc = could not find container \"6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839\": container with ID starting with 6f540e6915296ad59e820086dafef7be6d6f6acb95ca9e2c5f53598c14b48839 not found: ID does not exist"
Jul 01 18:29:08.702494 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:08.702415    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" path="/var/lib/kubelet/pods/364a1a1d-258d-4be1-b115-ec85f0e0502e/volumes"
Jul 01 18:29:11.922455 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922421    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"]
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922724    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kube-rbac-proxy"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922736    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kube-rbac-proxy"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922746    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kserve-container"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922752    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kserve-container"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922767    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="storage-initializer"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922772    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="storage-initializer"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922821    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kube-rbac-proxy"
Jul 01 18:29:11.922855 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.922829    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="364a1a1d-258d-4be1-b115-ec85f0e0502e" containerName="kserve-container"
Jul 01 18:29:11.925644 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.925627    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:11.928056 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.928025    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 18:29:11.928211 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.928064    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 18:29:11.928211 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.928181    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 18:29:11.928310 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.928275    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-predictor-serving-cert\""
Jul 01 18:29:11.928380 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.928366    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-kube-rbac-proxy-sar-config\""
Jul 01 18:29:11.929274 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.929251    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 18:29:11.929397 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.929376    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j88rw\""
Jul 01 18:29:11.935934 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:11.935908    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"]
Jul 01 18:29:12.036749 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.036713    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.036749 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.036757    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.036988 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.036793    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.036988 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.036811    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.036988 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.036842    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4w26\" (UniqueName: \"kubernetes.io/projected/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-api-access-z4w26\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.138268 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.138238    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.138268 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.138272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.138497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.138313    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4w26\" (UniqueName: \"kubernetes.io/projected/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-api-access-z4w26\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.138497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.138357    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.138497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.138394    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.138718 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.138691    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.139106 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.139085    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.139144 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.139085    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.140746 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.140723    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.147843 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.147820    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4w26\" (UniqueName: \"kubernetes.io/projected/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-api-access-z4w26\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.236978 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.236876    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:12.368894 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.368864    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"]
Jul 01 18:29:12.371308 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:29:12.371282    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5f19dd_bf66_44fc_8b2a_c7b93b8dd39b.slice/crio-f785ac9a31da04f7e0f36c4b851c6f4d19e1b9f64024556bdc30810a0f2e7afa WatchSource:0}: Error finding container f785ac9a31da04f7e0f36c4b851c6f4d19e1b9f64024556bdc30810a0f2e7afa: Status 404 returned error can't find the container with id f785ac9a31da04f7e0f36c4b851c6f4d19e1b9f64024556bdc30810a0f2e7afa
Jul 01 18:29:12.726915 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.726884    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:29:12.788600 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:12.788561    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:29:13.346454 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:13.346417    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerStarted","Data":"b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02"}
Jul 01 18:29:13.346944 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:13.346501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerStarted","Data":"f785ac9a31da04f7e0f36c4b851c6f4d19e1b9f64024556bdc30810a0f2e7afa"}
Jul 01 18:29:42.463438 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:42.463349    2555 generic.go:356] "Generic (PLEG): container finished" podID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerID="b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02" exitCode=0
Jul 01 18:29:42.463438 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:42.463423    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerDied","Data":"b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02"}
Jul 01 18:29:43.471358 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:43.471326    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerStarted","Data":"fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555"}
Jul 01 18:29:43.471887 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:43.471384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerStarted","Data":"e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0"}
Jul 01 18:29:43.471887 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:43.471565    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:43.489323 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:43.489267    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" podStartSLOduration=2.82226752 podStartE2EDuration="32.489248085s" totalImagesPullingTime="0s" totalInitContainerRuntime="29.666980565s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:43.489095062 +0000 UTC m=+1445.600670546" watchObservedRunningTime="2026-07-01 18:29:43.489248085 +0000 UTC m=+1445.600823556"
Jul 01 18:29:44.476110 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:44.476073    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:29:50.485726 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:29:50.485696    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:30:38.781374 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:30:38.781340    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:30:38.785505 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:30:38.785480    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:30:38.790999 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:30:38.790980    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:30:38.795333 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:30:38.795317    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:31:20.703834 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:20.703797    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:31:22.107047 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:22.107008    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"]
Jul 01 18:31:22.107491 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:22.107304    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kserve-container" containerID="cri-o://e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0" gracePeriod=30
Jul 01 18:31:22.107491 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:22.107387    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kube-rbac-proxy" containerID="cri-o://fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555" gracePeriod=30
Jul 01 18:31:22.158335 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:22.158299    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:22.870040 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:22.870011    2555 generic.go:356] "Generic (PLEG): container finished" podID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerID="fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555" exitCode=2
Jul 01 18:31:22.870145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:22.870057    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerDied","Data":"fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555"}
Jul 01 18:31:23.051357 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.051333    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:31:23.167356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167274    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-rbac-proxy-sar-config\") pod \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") "
Jul 01 18:31:23.167356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167309    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4w26\" (UniqueName: \"kubernetes.io/projected/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-api-access-z4w26\") pod \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") "
Jul 01 18:31:23.167356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167344    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-proxy-tls\") pod \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") "
Jul 01 18:31:23.167875 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167542    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-cabundle-cert\") pod \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") "
Jul 01 18:31:23.167875 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167636    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kserve-provision-location\") pod \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\" (UID: \"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b\") "
Jul 01 18:31:23.167875 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167763    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" (UID: "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:31:23.167998 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.167921    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" (UID: "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:31:23.168038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.168011    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:31:23.168038 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.168030    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:31:23.169922 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.169897    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" (UID: "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:31:23.170030 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.169944    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-api-access-z4w26" (OuterVolumeSpecName: "kube-api-access-z4w26") pod "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" (UID: "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b"). InnerVolumeSpecName "kube-api-access-z4w26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:31:23.172534 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.172500    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" (UID: "9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:31:23.268460 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.268423    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4w26\" (UniqueName: \"kubernetes.io/projected/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kube-api-access-z4w26\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:31:23.268460 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.268455    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:31:23.268460 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.268467    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:31:23.876375 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.876340    2555 generic.go:356] "Generic (PLEG): container finished" podID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerID="e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0" exitCode=0
Jul 01 18:31:23.876585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.876405    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"
Jul 01 18:31:23.876585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.876422    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerDied","Data":"e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0"}
Jul 01 18:31:23.876585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.876491    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx" event={"ID":"9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b","Type":"ContainerDied","Data":"f785ac9a31da04f7e0f36c4b851c6f4d19e1b9f64024556bdc30810a0f2e7afa"}
Jul 01 18:31:23.876585 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.876519    2555 scope.go:117] "RemoveContainer" containerID="fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555"
Jul 01 18:31:23.886497 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.886472    2555 scope.go:117] "RemoveContainer" containerID="e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0"
Jul 01 18:31:23.893628 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.893608    2555 scope.go:117] "RemoveContainer" containerID="b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02"
Jul 01 18:31:23.901218 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.901191    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"]
Jul 01 18:31:23.901802 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.901782    2555 scope.go:117] "RemoveContainer" containerID="fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555"
Jul 01 18:31:23.902136 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:31:23.902055    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555\": container with ID starting with fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555 not found: ID does not exist" containerID="fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555"
Jul 01 18:31:23.902136 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.902097    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555"} err="failed to get container status \"fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555\": rpc error: code = NotFound desc = could not find container \"fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555\": container with ID starting with fd1956282f012ca0978abdecf0c7894b5aa1664eaf63af2ff3eb0c2617a83555 not found: ID does not exist"
Jul 01 18:31:23.902136 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.902124    2555 scope.go:117] "RemoveContainer" containerID="e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0"
Jul 01 18:31:23.902436 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:31:23.902410    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0\": container with ID starting with e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0 not found: ID does not exist" containerID="e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0"
Jul 01 18:31:23.902487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.902447    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0"} err="failed to get container status \"e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0\": rpc error: code = NotFound desc = could not find container \"e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0\": container with ID starting with e34f9ae7dfc1e49f65e763114c441beda2c14e7e7c660d80f1869b26975ee3a0 not found: ID does not exist"
Jul 01 18:31:23.902487 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.902471    2555 scope.go:117] "RemoveContainer" containerID="b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02"
Jul 01 18:31:23.902790 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:31:23.902763    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02\": container with ID starting with b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02 not found: ID does not exist" containerID="b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02"
Jul 01 18:31:23.902888 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.902794    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02"} err="failed to get container status \"b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02\": rpc error: code = NotFound desc = could not find container \"b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02\": container with ID starting with b890151493b7764d4461d3fe3901ceb8ca6be37698745a066afd6fb649d30e02 not found: ID does not exist"
Jul 01 18:31:23.903569 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:23.903549    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-6g6bx"]
Jul 01 18:31:24.701850 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:24.701810    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" path="/var/lib/kubelet/pods/9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b/volumes"
Jul 01 18:31:27.231369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.231331    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.276354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276313    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"]
Jul 01 18:31:27.276696 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276679    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kube-rbac-proxy"
Jul 01 18:31:27.276777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276699    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kube-rbac-proxy"
Jul 01 18:31:27.276777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276718    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kserve-container"
Jul 01 18:31:27.276777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276725    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kserve-container"
Jul 01 18:31:27.276777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276750    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="storage-initializer"
Jul 01 18:31:27.276777 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276759    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="storage-initializer"
Jul 01 18:31:27.277037 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276828    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kserve-container"
Jul 01 18:31:27.277037 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.276842    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5f19dd-bf66-44fc-8b2a-c7b93b8dd39b" containerName="kube-rbac-proxy"
Jul 01 18:31:27.281698 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.281676    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.284491 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.284464    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 18:31:27.284641 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.284496    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 18:31:27.284641 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.284545    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 18:31:27.284641 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.284559    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-kube-rbac-proxy-sar-config\""
Jul 01 18:31:27.285396 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.285372    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j88rw\""
Jul 01 18:31:27.285490 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.285401    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-predictor-serving-cert\""
Jul 01 18:31:27.285490 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.285413    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 18:31:27.292206 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.292182    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"]
Jul 01 18:31:27.297107 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.297082    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba09ef89-9e79-42d7-8362-73504bdde689-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.297211 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.297129    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.297275 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.297212    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpd2b\" (UniqueName: \"kubernetes.io/projected/ba09ef89-9e79-42d7-8362-73504bdde689-kube-api-access-hpd2b\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.297275 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.297255    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.297378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.297276    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.397685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.397643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba09ef89-9e79-42d7-8362-73504bdde689-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.397685 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.397690    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.397938 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.397747    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpd2b\" (UniqueName: \"kubernetes.io/projected/ba09ef89-9e79-42d7-8362-73504bdde689-kube-api-access-hpd2b\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.397938 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.397788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.397938 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.397815    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.397938 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:31:27.397860    2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-serving-cert: secret "isvc-autogluon-v2-noslash-predictor-serving-cert" not found
Jul 01 18:31:27.398145 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:31:27.397945    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls podName:ba09ef89-9e79-42d7-8362-73504bdde689 nodeName:}" failed. No retries permitted until 2026-07-01 18:31:27.897925181 +0000 UTC m=+1550.009500632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls") pod "isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" (UID: "ba09ef89-9e79-42d7-8362-73504bdde689") : secret "isvc-autogluon-v2-noslash-predictor-serving-cert" not found
Jul 01 18:31:27.398145 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.398050    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba09ef89-9e79-42d7-8362-73504bdde689-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.398419 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.398401    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.398485 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.398467    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.414851 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.414826    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpd2b\" (UniqueName: \"kubernetes.io/projected/ba09ef89-9e79-42d7-8362-73504bdde689-kube-api-access-hpd2b\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.555434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.555397    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.901255 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.901173    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:27.903410 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:27.903393    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:28.193135 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:28.193042    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:28.322214 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:28.322187    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"]
Jul 01 18:31:28.324514 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:31:28.324487    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba09ef89_9e79_42d7_8362_73504bdde689.slice/crio-a533b76cc57028ae28506303413338e4aaa804e1cafc9224ec6e6333a22656d5 WatchSource:0}: Error finding container a533b76cc57028ae28506303413338e4aaa804e1cafc9224ec6e6333a22656d5: Status 404 returned error can't find the container with id a533b76cc57028ae28506303413338e4aaa804e1cafc9224ec6e6333a22656d5
Jul 01 18:31:28.899163 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:28.899130    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerStarted","Data":"662d79c497805eac54dbea96f69ae1aec043110dc5e34cd9f5d99b18178708a4"}
Jul 01 18:31:28.899320 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:28.899187    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerStarted","Data":"a533b76cc57028ae28506303413338e4aaa804e1cafc9224ec6e6333a22656d5"}
Jul 01 18:31:33.921262 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:33.921230    2555 generic.go:356] "Generic (PLEG): container finished" podID="ba09ef89-9e79-42d7-8362-73504bdde689" containerID="662d79c497805eac54dbea96f69ae1aec043110dc5e34cd9f5d99b18178708a4" exitCode=0
Jul 01 18:31:33.921663 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:33.921284    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerDied","Data":"662d79c497805eac54dbea96f69ae1aec043110dc5e34cd9f5d99b18178708a4"}
Jul 01 18:31:34.928144 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:34.928106    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerStarted","Data":"d2fdde184a203732e97c0cbaf8a058552b4eaad8aba84da9cdb153c8e927818c"}
Jul 01 18:31:34.930435 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:34.928170    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerStarted","Data":"0f23247dd21e7ee3dfee8acbc55b1a12ccfeaba6ef83aa849e871fe63d3bb9eb"}
Jul 01 18:31:34.930435 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:34.928382    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:34.930435 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:34.928557    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:31:34.947778 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:34.947729    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" podStartSLOduration=3.138223209 podStartE2EDuration="7.94771533s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.809492121s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:31:34.945838095 +0000 UTC m=+1557.057413581" watchObservedRunningTime="2026-07-01 18:31:34.94771533 +0000 UTC m=+1557.059290802"
Jul 01 18:31:39.284241 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:39.284154    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:40.939982 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:31:40.939954    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:32:14.829014 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:32:14.828970    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:35.580478 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:32:35.580392    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:10.702174 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:10.702142    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:33:17.413775 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:17.413735    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"]
Jul 01 18:33:17.414256 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:17.414068    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kserve-container" containerID="cri-o://0f23247dd21e7ee3dfee8acbc55b1a12ccfeaba6ef83aa849e871fe63d3bb9eb" gracePeriod=30
Jul 01 18:33:17.414256 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:17.414114    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kube-rbac-proxy" containerID="cri-o://d2fdde184a203732e97c0cbaf8a058552b4eaad8aba84da9cdb153c8e927818c" gracePeriod=30
Jul 01 18:33:17.431431 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:17.431407    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:18.347923 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.347891    2555 generic.go:356] "Generic (PLEG): container finished" podID="ba09ef89-9e79-42d7-8362-73504bdde689" containerID="d2fdde184a203732e97c0cbaf8a058552b4eaad8aba84da9cdb153c8e927818c" exitCode=2
Jul 01 18:33:18.347923 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.347917    2555 generic.go:356] "Generic (PLEG): container finished" podID="ba09ef89-9e79-42d7-8362-73504bdde689" containerID="0f23247dd21e7ee3dfee8acbc55b1a12ccfeaba6ef83aa849e871fe63d3bb9eb" exitCode=0
Jul 01 18:33:18.348102 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.347960    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerDied","Data":"d2fdde184a203732e97c0cbaf8a058552b4eaad8aba84da9cdb153c8e927818c"}
Jul 01 18:33:18.348102 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.348015    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerDied","Data":"0f23247dd21e7ee3dfee8acbc55b1a12ccfeaba6ef83aa849e871fe63d3bb9eb"}
Jul 01 18:33:18.364362 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.364337    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:33:18.450682 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.450581    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls\") pod \"ba09ef89-9e79-42d7-8362-73504bdde689\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") "
Jul 01 18:33:18.450682 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.450618    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpd2b\" (UniqueName: \"kubernetes.io/projected/ba09ef89-9e79-42d7-8362-73504bdde689-kube-api-access-hpd2b\") pod \"ba09ef89-9e79-42d7-8362-73504bdde689\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") "
Jul 01 18:33:18.450682 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.450650    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba09ef89-9e79-42d7-8362-73504bdde689-kserve-provision-location\") pod \"ba09ef89-9e79-42d7-8362-73504bdde689\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") "
Jul 01 18:33:18.450682 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.450674    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-cabundle-cert\") pod \"ba09ef89-9e79-42d7-8362-73504bdde689\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") "
Jul 01 18:33:18.451236 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.450709    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-kube-rbac-proxy-sar-config\") pod \"ba09ef89-9e79-42d7-8362-73504bdde689\" (UID: \"ba09ef89-9e79-42d7-8362-73504bdde689\") "
Jul 01 18:33:18.451236 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.451063    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ba09ef89-9e79-42d7-8362-73504bdde689" (UID: "ba09ef89-9e79-42d7-8362-73504bdde689"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:33:18.451236 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.451129    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ba09ef89-9e79-42d7-8362-73504bdde689" (UID: "ba09ef89-9e79-42d7-8362-73504bdde689"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:33:18.452926 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.452894    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ba09ef89-9e79-42d7-8362-73504bdde689" (UID: "ba09ef89-9e79-42d7-8362-73504bdde689"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:33:18.452926 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.452902    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba09ef89-9e79-42d7-8362-73504bdde689-kube-api-access-hpd2b" (OuterVolumeSpecName: "kube-api-access-hpd2b") pod "ba09ef89-9e79-42d7-8362-73504bdde689" (UID: "ba09ef89-9e79-42d7-8362-73504bdde689"). InnerVolumeSpecName "kube-api-access-hpd2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:33:18.455317 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.455297    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba09ef89-9e79-42d7-8362-73504bdde689-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ba09ef89-9e79-42d7-8362-73504bdde689" (UID: "ba09ef89-9e79-42d7-8362-73504bdde689"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:33:18.552230 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.552191    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:18.552411 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.552242    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba09ef89-9e79-42d7-8362-73504bdde689-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:18.552411 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.552252    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpd2b\" (UniqueName: \"kubernetes.io/projected/ba09ef89-9e79-42d7-8362-73504bdde689-kube-api-access-hpd2b\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:18.552411 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.552261    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba09ef89-9e79-42d7-8362-73504bdde689-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:18.552411 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:18.552270    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba09ef89-9e79-42d7-8362-73504bdde689-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:19.353901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.353862    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br" event={"ID":"ba09ef89-9e79-42d7-8362-73504bdde689","Type":"ContainerDied","Data":"a533b76cc57028ae28506303413338e4aaa804e1cafc9224ec6e6333a22656d5"}
Jul 01 18:33:19.353901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.353901    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"
Jul 01 18:33:19.354120 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.353947    2555 scope.go:117] "RemoveContainer" containerID="d2fdde184a203732e97c0cbaf8a058552b4eaad8aba84da9cdb153c8e927818c"
Jul 01 18:33:19.362149 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.362109    2555 scope.go:117] "RemoveContainer" containerID="0f23247dd21e7ee3dfee8acbc55b1a12ccfeaba6ef83aa849e871fe63d3bb9eb"
Jul 01 18:33:19.369383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.369362    2555 scope.go:117] "RemoveContainer" containerID="662d79c497805eac54dbea96f69ae1aec043110dc5e34cd9f5d99b18178708a4"
Jul 01 18:33:19.373267 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.373243    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"]
Jul 01 18:33:19.379159 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:19.379138    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-tw7br"]
Jul 01 18:33:20.702211 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:20.702179    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" path="/var/lib/kubelet/pods/ba09ef89-9e79-42d7-8362-73504bdde689/volumes"
Jul 01 18:33:22.531259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.531220    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:22.590413 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590376    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"]
Jul 01 18:33:22.590689 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590676    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kube-rbac-proxy"
Jul 01 18:33:22.590689 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590690    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kube-rbac-proxy"
Jul 01 18:33:22.590803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590702    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kserve-container"
Jul 01 18:33:22.590803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590707    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kserve-container"
Jul 01 18:33:22.590803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590721    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="storage-initializer"
Jul 01 18:33:22.590803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590728    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="storage-initializer"
Jul 01 18:33:22.590803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590778    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kserve-container"
Jul 01 18:33:22.590803 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.590785    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba09ef89-9e79-42d7-8362-73504bdde689" containerName="kube-rbac-proxy"
Jul 01 18:33:22.595930 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.595910    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.598720 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.598693    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 18:33:22.598889 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.598740    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-kube-rbac-proxy-sar-config\""
Jul 01 18:33:22.598965 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.598955    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j88rw\""
Jul 01 18:33:22.599014 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.598972    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 18:33:22.599752 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.599732    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 18:33:22.599859 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.599764    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-predictor-serving-cert\""
Jul 01 18:33:22.599859 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.599778    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 18:33:22.604615 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.604592    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"]
Jul 01 18:33:22.688919 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.688886    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.689122 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.688930    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.689122 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.688951    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.689122 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.689052    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.689122 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.689116    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wwpp\" (UniqueName: \"kubernetes.io/projected/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-api-access-9wwpp\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.735922 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.735886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:22.790115 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790081    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790276 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790276 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790172    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790276 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790200    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790276 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790251    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wwpp\" (UniqueName: \"kubernetes.io/projected/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-api-access-9wwpp\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790849 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790820    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790953 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790860    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.790995 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.790961    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.792780 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.792758    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.799762 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.799742    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wwpp\" (UniqueName: \"kubernetes.io/projected/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-api-access-9wwpp\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:22.906649 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:22.906607    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:23.043344 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:23.043244    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"]
Jul 01 18:33:23.047246 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:33:23.047198    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a3fa31_cecc_45b9_89cb_dd4efc1518f9.slice/crio-d6e56bee9967b94c66ef4b054fcfca49ec0d4de455550044f9e7933fb4055d72 WatchSource:0}: Error finding container d6e56bee9967b94c66ef4b054fcfca49ec0d4de455550044f9e7933fb4055d72: Status 404 returned error can't find the container with id d6e56bee9967b94c66ef4b054fcfca49ec0d4de455550044f9e7933fb4055d72
Jul 01 18:33:23.372239 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:23.372139    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerStarted","Data":"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"}
Jul 01 18:33:23.372421 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:23.372258    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerStarted","Data":"d6e56bee9967b94c66ef4b054fcfca49ec0d4de455550044f9e7933fb4055d72"}
Jul 01 18:33:33.415816 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:33.415778    2555 generic.go:356] "Generic (PLEG): container finished" podID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerID="7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d" exitCode=0
Jul 01 18:33:33.416295 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:33.415825    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerDied","Data":"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"}
Jul 01 18:33:34.422970 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:34.422936    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerStarted","Data":"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"}
Jul 01 18:33:34.423354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:34.422998    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerStarted","Data":"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"}
Jul 01 18:33:34.423354 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:34.423182    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:34.443519 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:34.443464    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" podStartSLOduration=2.921701442 podStartE2EDuration="12.443448483s" totalImagesPullingTime="0s" totalInitContainerRuntime="9.521747041s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:34.442150369 +0000 UTC m=+1676.553725854" watchObservedRunningTime="2026-07-01 18:33:34.443448483 +0000 UTC m=+1676.555023954"
Jul 01 18:33:35.427211 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:35.427178    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:35.428659 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:35.428632    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:33:36.432544 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:36.432479    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:33:41.436760 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:41.436732    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:41.437242 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:41.437216    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:33:51.437742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:51.437709    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:52.634488 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:52.634452    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"]
Jul 01 18:33:52.634910 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:52.634673    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container" containerID="cri-o://051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e" gracePeriod=30
Jul 01 18:33:52.634910 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:52.634726    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kube-rbac-proxy" containerID="cri-o://1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651" gracePeriod=30
Jul 01 18:33:52.765577 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:52.765536    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:53.492207 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.492181    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:53.506140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506110    2555 generic.go:356] "Generic (PLEG): container finished" podID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerID="1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651" exitCode=2
Jul 01 18:33:53.506140 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506135    2555 generic.go:356] "Generic (PLEG): container finished" podID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerID="051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e" exitCode=0
Jul 01 18:33:53.506369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506165    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"
Jul 01 18:33:53.506369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506187    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerDied","Data":"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"}
Jul 01 18:33:53.506369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506294    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerDied","Data":"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"}
Jul 01 18:33:53.506369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506328    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt" event={"ID":"23a3fa31-cecc-45b9-89cb-dd4efc1518f9","Type":"ContainerDied","Data":"d6e56bee9967b94c66ef4b054fcfca49ec0d4de455550044f9e7933fb4055d72"}
Jul 01 18:33:53.506369 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.506343    2555 scope.go:117] "RemoveContainer" containerID="1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"
Jul 01 18:33:53.515894 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.515876    2555 scope.go:117] "RemoveContainer" containerID="051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"
Jul 01 18:33:53.523870 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.523848    2555 scope.go:117] "RemoveContainer" containerID="7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"
Jul 01 18:33:53.532943 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.532922    2555 scope.go:117] "RemoveContainer" containerID="1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"
Jul 01 18:33:53.533252 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:33:53.533227    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651\": container with ID starting with 1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651 not found: ID does not exist" containerID="1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"
Jul 01 18:33:53.533337 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.533266    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"} err="failed to get container status \"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651\": rpc error: code = NotFound desc = could not find container \"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651\": container with ID starting with 1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651 not found: ID does not exist"
Jul 01 18:33:53.533337 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.533293    2555 scope.go:117] "RemoveContainer" containerID="051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"
Jul 01 18:33:53.533619 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:33:53.533597    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e\": container with ID starting with 051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e not found: ID does not exist" containerID="051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"
Jul 01 18:33:53.533684 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.533630    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"} err="failed to get container status \"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e\": rpc error: code = NotFound desc = could not find container \"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e\": container with ID starting with 051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e not found: ID does not exist"
Jul 01 18:33:53.533684 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.533649    2555 scope.go:117] "RemoveContainer" containerID="7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"
Jul 01 18:33:53.533887 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:33:53.533873    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d\": container with ID starting with 7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d not found: ID does not exist" containerID="7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"
Jul 01 18:33:53.533935 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.533889    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"} err="failed to get container status \"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d\": rpc error: code = NotFound desc = could not find container \"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d\": container with ID starting with 7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d not found: ID does not exist"
Jul 01 18:33:53.533935 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.533908    2555 scope.go:117] "RemoveContainer" containerID="1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"
Jul 01 18:33:53.534147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.534120    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651"} err="failed to get container status \"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651\": rpc error: code = NotFound desc = could not find container \"1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651\": container with ID starting with 1546d5d00f2a5abed73358d42ab4f1c789d3289a72e444c92f73d95d12cdc651 not found: ID does not exist"
Jul 01 18:33:53.534147 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.534142    2555 scope.go:117] "RemoveContainer" containerID="051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"
Jul 01 18:33:53.534367 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.534351    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e"} err="failed to get container status \"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e\": rpc error: code = NotFound desc = could not find container \"051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e\": container with ID starting with 051bd0e50f218862d0f6bf52e26c4ac784c709f01b290485271280d1e193f54e not found: ID does not exist"
Jul 01 18:33:53.534421 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.534367    2555 scope.go:117] "RemoveContainer" containerID="7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"
Jul 01 18:33:53.534597 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.534580    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d"} err="failed to get container status \"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d\": rpc error: code = NotFound desc = could not find container \"7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d\": container with ID starting with 7b7f36ad666de43e30d130db77ea499555c0f66711a29ff7f88786559089772d not found: ID does not exist"
Jul 01 18:33:53.551901 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.551882    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kserve-provision-location\") pod \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") "
Jul 01 18:33:53.552010 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.551998    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-proxy-tls\") pod \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") "
Jul 01 18:33:53.552060 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.552022    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wwpp\" (UniqueName: \"kubernetes.io/projected/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-api-access-9wwpp\") pod \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") "
Jul 01 18:33:53.552060 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.552048    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-rbac-proxy-sar-config\") pod \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") "
Jul 01 18:33:53.552138 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.552072    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-cabundle-cert\") pod \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\" (UID: \"23a3fa31-cecc-45b9-89cb-dd4efc1518f9\") "
Jul 01 18:33:53.552434 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.552412    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "23a3fa31-cecc-45b9-89cb-dd4efc1518f9" (UID: "23a3fa31-cecc-45b9-89cb-dd4efc1518f9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:33:53.552501 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.552457    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "23a3fa31-cecc-45b9-89cb-dd4efc1518f9" (UID: "23a3fa31-cecc-45b9-89cb-dd4efc1518f9"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:33:53.552882 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.552862    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "23a3fa31-cecc-45b9-89cb-dd4efc1518f9" (UID: "23a3fa31-cecc-45b9-89cb-dd4efc1518f9"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:33:53.554016 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.553997    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-api-access-9wwpp" (OuterVolumeSpecName: "kube-api-access-9wwpp") pod "23a3fa31-cecc-45b9-89cb-dd4efc1518f9" (UID: "23a3fa31-cecc-45b9-89cb-dd4efc1518f9"). InnerVolumeSpecName "kube-api-access-9wwpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:33:53.554097 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.554042    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "23a3fa31-cecc-45b9-89cb-dd4efc1518f9" (UID: "23a3fa31-cecc-45b9-89cb-dd4efc1518f9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:33:53.653299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.653221    2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-proxy-tls\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:53.653299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.653250    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wwpp\" (UniqueName: \"kubernetes.io/projected/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-api-access-9wwpp\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:53.653299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.653260    2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:53.653299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.653269    2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-cabundle-cert\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:53.653299 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.653278    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/23a3fa31-cecc-45b9-89cb-dd4efc1518f9-kserve-provision-location\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:33:53.828210 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.828175    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"]
Jul 01 18:33:53.832102 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:53.832078    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-m5npt"]
Jul 01 18:33:54.702068 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:54.702035    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" path="/var/lib/kubelet/pods/23a3fa31-cecc-45b9-89cb-dd4efc1518f9/volumes"
Jul 01 18:33:58.515199 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515165    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bxvpg/must-gather-w2h9z"]
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515453    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="storage-initializer"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515464    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="storage-initializer"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515477    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515484    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515495    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kube-rbac-proxy"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515501    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kube-rbac-proxy"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515566    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kube-rbac-proxy"
Jul 01 18:33:58.515596 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.515574    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a3fa31-cecc-45b9-89cb-dd4efc1518f9" containerName="kserve-container"
Jul 01 18:33:58.520170 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.520143    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.524713 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.524692    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bxvpg\"/\"kube-root-ca.crt\""
Jul 01 18:33:58.525810 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.525776    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bxvpg\"/\"default-dockercfg-68jxm\""
Jul 01 18:33:58.525942 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.525836    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bxvpg\"/\"openshift-service-ca.crt\""
Jul 01 18:33:58.528184 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.528161    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bxvpg/must-gather-w2h9z"]
Jul 01 18:33:58.531356 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.531329    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:58.585566 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.585510    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:58.589540 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.589507    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c195d30-d021-4003-8517-21d436227185-must-gather-output\") pod \"must-gather-w2h9z\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") " pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.589665 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.589623    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5kt\" (UniqueName: \"kubernetes.io/projected/9c195d30-d021-4003-8517-21d436227185-kube-api-access-lq5kt\") pod \"must-gather-w2h9z\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") " pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.690835 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.690802    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5kt\" (UniqueName: \"kubernetes.io/projected/9c195d30-d021-4003-8517-21d436227185-kube-api-access-lq5kt\") pod \"must-gather-w2h9z\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") " pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.691011 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.690857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c195d30-d021-4003-8517-21d436227185-must-gather-output\") pod \"must-gather-w2h9z\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") " pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.691242 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.691224    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c195d30-d021-4003-8517-21d436227185-must-gather-output\") pod \"must-gather-w2h9z\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") " pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.698947 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.698922    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5kt\" (UniqueName: \"kubernetes.io/projected/9c195d30-d021-4003-8517-21d436227185-kube-api-access-lq5kt\") pod \"must-gather-w2h9z\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") " pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.836474 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.836440    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:33:58.968041 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.967621    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bxvpg/must-gather-w2h9z"]
Jul 01 18:33:58.969717 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:58.969698    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:33:59.531583 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:33:59.531500    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxvpg/must-gather-w2h9z" event={"ID":"9c195d30-d021-4003-8517-21d436227185","Type":"ContainerStarted","Data":"50655810771bc6c6ba9c01a58c6c5d9f5beb090a06978999b722bd02d5bc1320"}
Jul 01 18:34:06.569062 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:06.569020    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxvpg/must-gather-w2h9z" event={"ID":"9c195d30-d021-4003-8517-21d436227185","Type":"ContainerStarted","Data":"bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c"}
Jul 01 18:34:06.569507 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:06.569075    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxvpg/must-gather-w2h9z" event={"ID":"9c195d30-d021-4003-8517-21d436227185","Type":"ContainerStarted","Data":"c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"}
Jul 01 18:34:06.585410 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:06.585340    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bxvpg/must-gather-w2h9z" podStartSLOduration=2.026844637 podStartE2EDuration="8.585321433s" totalImagesPullingTime="6.558476796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:06.584442655 +0000 UTC m=+1708.696018127" watchObservedRunningTime="2026-07-01 18:34:06.585321433 +0000 UTC m=+1708.696896883"
Jul 01 18:34:26.663756 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:26.663721    2555 generic.go:356] "Generic (PLEG): container finished" podID="9c195d30-d021-4003-8517-21d436227185" containerID="c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34" exitCode=0
Jul 01 18:34:26.664259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:26.663777    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxvpg/must-gather-w2h9z" event={"ID":"9c195d30-d021-4003-8517-21d436227185","Type":"ContainerDied","Data":"c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"}
Jul 01 18:34:26.664259 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:26.664094    2555 scope.go:117] "RemoveContainer" containerID="c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"
Jul 01 18:34:27.002730 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:27.002634    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bxvpg_must-gather-w2h9z_9c195d30-d021-4003-8517-21d436227185/gather/0.log"
Jul 01 18:34:27.420053 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:27.420003    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:34:27.576258 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:27.576220    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:34:27.634451 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:27.634414    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:34:30.417754 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:30.417715    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-45glq_d2f3640b-50fa-44a1-88ac-91110982cd62/global-pull-secret-syncer/0.log"
Jul 01 18:34:30.528783 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:30.528748    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log"
Jul 01 18:34:30.628432 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:30.628399    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-158.ec2.internal_be78b4b5448f62b72b8455220a367a2d/haproxy/0.log"
Jul 01 18:34:32.440597 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.440564    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bxvpg/must-gather-w2h9z"]
Jul 01 18:34:32.441030 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.440757    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-bxvpg/must-gather-w2h9z" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="copy" containerID="cri-o://bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c" gracePeriod=2
Jul 01 18:34:32.443545 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:34:32.443490    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-w2h9z\" is forbidden: User \"system:node:ip-10-0-136-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bxvpg\": no relationship found between node 'ip-10-0-136-158.ec2.internal' and this object" podUID="9c195d30-d021-4003-8517-21d436227185" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:34:32.445315 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.444775    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bxvpg/must-gather-w2h9z"]
Jul 01 18:34:32.671112 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.671089    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bxvpg_must-gather-w2h9z_9c195d30-d021-4003-8517-21d436227185/copy/0.log"
Jul 01 18:34:32.672700 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.672684    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:34:32.675049 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:34:32.675027    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-w2h9z\" is forbidden: User \"system:node:ip-10-0-136-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bxvpg\": no relationship found between node 'ip-10-0-136-158.ec2.internal' and this object" podUID="9c195d30-d021-4003-8517-21d436227185" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:34:32.688556 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.688535    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bxvpg_must-gather-w2h9z_9c195d30-d021-4003-8517-21d436227185/copy/0.log"
Jul 01 18:34:32.688915 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.688890    2555 generic.go:356] "Generic (PLEG): container finished" podID="9c195d30-d021-4003-8517-21d436227185" containerID="bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c" exitCode=143
Jul 01 18:34:32.689006 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.688935    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:34:32.689006 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.688997    2555 scope.go:117] "RemoveContainer" containerID="bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c"
Jul 01 18:34:32.691499 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:34:32.691450    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-w2h9z\" is forbidden: User \"system:node:ip-10-0-136-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bxvpg\": no relationship found between node 'ip-10-0-136-158.ec2.internal' and this object" podUID="9c195d30-d021-4003-8517-21d436227185" pod="openshift-must-gather-bxvpg/must-gather-w2h9z"
Jul 01 18:34:32.696282 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.696268    2555 scope.go:117] "RemoveContainer" containerID="c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"
Jul 01 18:34:32.709715 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.709698    2555 scope.go:117] "RemoveContainer" containerID="bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c"
Jul 01 18:34:32.709962 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:34:32.709943    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c\": container with ID starting with bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c not found: ID does not exist" containerID="bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c"
Jul 01 18:34:32.710035 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.709975    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c"} err="failed to get container status \"bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c\": rpc error: code = NotFound desc = could not find container \"bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c\": container with ID starting with bd821516adba9a4a8a9613703b908bb2b503fdb10a7d10d0d74ea097bcd6e43c not found: ID does not exist"
Jul 01 18:34:32.710035 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.710001    2555 scope.go:117] "RemoveContainer" containerID="c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"
Jul 01 18:34:32.710237 ip-10-0-136-158 kubenswrapper[2555]: E0701 18:34:32.710220    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34\": container with ID starting with c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34 not found: ID does not exist" containerID="c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"
Jul 01 18:34:32.710282 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.710245    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34"} err="failed to get container status \"c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34\": rpc error: code = NotFound desc = could not find container \"c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34\": container with ID starting with c49a7572a78bdcad58f549125490069ddfac46a2267267e41c6f22fb906d1e34 not found: ID does not exist"
Jul 01 18:34:32.808378 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.808350    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c195d30-d021-4003-8517-21d436227185-must-gather-output\") pod \"9c195d30-d021-4003-8517-21d436227185\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") "
Jul 01 18:34:32.808564 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.808409    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq5kt\" (UniqueName: \"kubernetes.io/projected/9c195d30-d021-4003-8517-21d436227185-kube-api-access-lq5kt\") pod \"9c195d30-d021-4003-8517-21d436227185\" (UID: \"9c195d30-d021-4003-8517-21d436227185\") "
Jul 01 18:34:32.809745 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.809721    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c195d30-d021-4003-8517-21d436227185-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9c195d30-d021-4003-8517-21d436227185" (UID: "9c195d30-d021-4003-8517-21d436227185"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:34:32.810625 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.810604    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c195d30-d021-4003-8517-21d436227185-kube-api-access-lq5kt" (OuterVolumeSpecName: "kube-api-access-lq5kt") pod "9c195d30-d021-4003-8517-21d436227185" (UID: "9c195d30-d021-4003-8517-21d436227185"). InnerVolumeSpecName "kube-api-access-lq5kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:34:32.909845 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.909810    2555 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c195d30-d021-4003-8517-21d436227185-must-gather-output\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:34:32.909845 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:32.909841    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq5kt\" (UniqueName: \"kubernetes.io/projected/9c195d30-d021-4003-8517-21d436227185-kube-api-access-lq5kt\") on node \"ip-10-0-136-158.ec2.internal\" DevicePath \"\""
Jul 01 18:34:33.756415 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:33.756380    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:34:33.823514 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:33.823478    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5v7mh_25403b06-7be2-437d-ae52-105582dbf646/konnectivity-agent/0.log" limit=1024
Jul 01 18:34:34.304223 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.304193    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/1.log"
Jul 01 18:34:34.456865 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.456828    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-xdj5w_74f37af7-55d5-4a5d-ba56-3a9c475e6f9f/cluster-monitoring-operator/0.log"
Jul 01 18:34:34.580976 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.580890    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9d544f8f9-d54mk_2005efb6-cb0a-4fba-b6be-9f8dcd6510e1/metrics-server/0.log"
Jul 01 18:34:34.649342 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.649314    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fqnf5_8ae24a19-279d-411f-b72d-8095dd8fd721/node-exporter/0.log"
Jul 01 18:34:34.676725 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.676669    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fqnf5_8ae24a19-279d-411f-b72d-8095dd8fd721/kube-rbac-proxy/0.log"
Jul 01 18:34:34.701857 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.701820    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c195d30-d021-4003-8517-21d436227185" path="/var/lib/kubelet/pods/9c195d30-d021-4003-8517-21d436227185/volumes"
Jul 01 18:34:34.703364 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:34.703345    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fqnf5_8ae24a19-279d-411f-b72d-8095dd8fd721/init-textfile/0.log"
Jul 01 18:34:35.060677 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.060650    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/prometheus/0.log"
Jul 01 18:34:35.084854 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.084828    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/config-reloader/0.log"
Jul 01 18:34:35.118503 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.118483    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/thanos-sidecar/0.log"
Jul 01 18:34:35.140877 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.140857    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/kube-rbac-proxy-web/0.log"
Jul 01 18:34:35.166838 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.166818    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/kube-rbac-proxy/0.log"
Jul 01 18:34:35.188644 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.188609    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/kube-rbac-proxy-thanos/0.log"
Jul 01 18:34:35.219059 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.219038    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_46a33874-7e47-4e9c-b123-1fc3bde08780/init-config-reloader/0.log"
Jul 01 18:34:35.252245 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.252221    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-jdt9l_b4e0eec2-372a-49fe-864e-ee0b4fcc5048/prometheus-operator/0.log"
Jul 01 18:34:35.278881 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:35.278855    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-jdt9l_b4e0eec2-372a-49fe-864e-ee0b4fcc5048/kube-rbac-proxy/0.log"
Jul 01 18:34:36.823598 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:36.823567    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-rqflz_4ef0201e-2031-49b3-a2ad-49424aa639ac/networking-console-plugin/0.log"
Jul 01 18:34:38.361805 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.361774    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-bhs6v_47db5141-3d57-4582-a386-c7f18064e5b4/volume-data-source-validator/0.log"
Jul 01 18:34:38.722408 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722336    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"]
Jul 01 18:34:38.722638 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722625    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="gather"
Jul 01 18:34:38.722694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722639    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="gather"
Jul 01 18:34:38.722694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722662    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="copy"
Jul 01 18:34:38.722694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722668    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="copy"
Jul 01 18:34:38.722797 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722709    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="gather"
Jul 01 18:34:38.722797 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.722719    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c195d30-d021-4003-8517-21d436227185" containerName="copy"
Jul 01 18:34:38.726257 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.726235    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.728799 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.728780    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vfjm\"/\"kube-root-ca.crt\""
Jul 01 18:34:38.728799 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.728797    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vfjm\"/\"openshift-service-ca.crt\""
Jul 01 18:34:38.729838 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.729821    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9vfjm\"/\"default-dockercfg-ph8jm\""
Jul 01 18:34:38.736519 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.736493    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"]
Jul 01 18:34:38.757481 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.757443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-podres\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.757678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.757490    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-sys\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.757678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.757547    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-lib-modules\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.757678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.757582    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xr9g\" (UniqueName: \"kubernetes.io/projected/16331393-e3e9-4e63-8d33-71ff7c49a1a1-kube-api-access-8xr9g\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.757678 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.757647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-proc\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858187 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-lib-modules\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858202    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xr9g\" (UniqueName: \"kubernetes.io/projected/16331393-e3e9-4e63-8d33-71ff7c49a1a1-kube-api-access-8xr9g\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-proc\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858292    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-podres\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858325    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-sys\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858333    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-lib-modules\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858383 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858357    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-proc\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858621 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858396    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-sys\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.858621 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.858410    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16331393-e3e9-4e63-8d33-71ff7c49a1a1-podres\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:38.866815 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:38.866793    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xr9g\" (UniqueName: \"kubernetes.io/projected/16331393-e3e9-4e63-8d33-71ff7c49a1a1-kube-api-access-8xr9g\") pod \"perf-node-gather-daemonset-jdqbf\" (UID: \"16331393-e3e9-4e63-8d33-71ff7c49a1a1\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:39.036727 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.036700    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:39.169694 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.169666    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"]
Jul 01 18:34:39.171837 ip-10-0-136-158 kubenswrapper[2555]: W0701 18:34:39.171813    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16331393_e3e9_4e63_8d33_71ff7c49a1a1.slice/crio-df8506d2e7af61c23af4be571d4f48d1839f5dc855ab09aad3cc6404f6e0937e WatchSource:0}: Error finding container df8506d2e7af61c23af4be571d4f48d1839f5dc855ab09aad3cc6404f6e0937e: Status 404 returned error can't find the container with id df8506d2e7af61c23af4be571d4f48d1839f5dc855ab09aad3cc6404f6e0937e
Jul 01 18:34:39.452298 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.452270    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qdwg7_d8959a7b-56e5-4c96-8561-2ab4288cb369/dns/0.log"
Jul 01 18:34:39.473766 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.473739    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qdwg7_d8959a7b-56e5-4c96-8561-2ab4288cb369/kube-rbac-proxy/0.log"
Jul 01 18:34:39.539266 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.539224    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cwvg4_f38e95fd-285d-43a4-b6cf-b47d611d6ef3/dns-node-resolver/0.log"
Jul 01 18:34:39.717160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.717061    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf" event={"ID":"16331393-e3e9-4e63-8d33-71ff7c49a1a1","Type":"ContainerStarted","Data":"9d7a8af72673daf790d4becc8ba33a7b98306c50cd15eb4609cf66f898be7c27"}
Jul 01 18:34:39.717160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.717118    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf" event={"ID":"16331393-e3e9-4e63-8d33-71ff7c49a1a1","Type":"ContainerStarted","Data":"df8506d2e7af61c23af4be571d4f48d1839f5dc855ab09aad3cc6404f6e0937e"}
Jul 01 18:34:39.717160 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.717146    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:39.733262 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:39.733217    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf" podStartSLOduration=1.733202959 podStartE2EDuration="1.733202959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:39.732374907 +0000 UTC m=+1741.843950379" watchObservedRunningTime="2026-07-01 18:34:39.733202959 +0000 UTC m=+1741.844778431"
Jul 01 18:34:40.038709 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:40.038677    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5444d8698d-9mc66_a27cbda6-45aa-428a-af75-698d0b8cdd41/registry/0.log"
Jul 01 18:34:40.060005 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:40.059972    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dwx5g_41f74c25-f487-4a07-ba33-d5b5118be585/node-ca/0.log"
Jul 01 18:34:41.245061 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:41.245023    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6npx9_da830e61-78b5-466a-9ece-ccc593a5f8f4/serve-healthcheck-canary/0.log"
Jul 01 18:34:41.672930 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:41.672897    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-s8mwl_e1ebe241-4196-4ecf-899b-4680e42bde79/insights-operator/1.log"
Jul 01 18:34:41.673137 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:41.673103    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-s8mwl_e1ebe241-4196-4ecf-899b-4680e42bde79/insights-operator/0.log"
Jul 01 18:34:41.830239 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:41.830212    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lfktk_c6bd40db-b821-4a92-8e59-5e4793a04400/kube-rbac-proxy/0.log"
Jul 01 18:34:41.850639 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:41.850613    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lfktk_c6bd40db-b821-4a92-8e59-5e4793a04400/exporter/0.log"
Jul 01 18:34:41.871805 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:41.871782    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lfktk_c6bd40db-b821-4a92-8e59-5e4793a04400/extractor/0.log"
Jul 01 18:34:44.032894 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.032863    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9kw45_3dab095d-ed9e-418c-8c40-3f411bbdfe01/s3-init/0.log"
Jul 01 18:34:44.048419 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.048394    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9kw45_3dab095d-ed9e-418c-8c40-3f411bbdfe01/download-hf-model/0.log"
Jul 01 18:34:44.079922 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.079899    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-tkml4_24f04956-ddb1-4c36-a03a-7e9bbd225d64/s3-tls-init-custom/0.log"
Jul 01 18:34:44.097577 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.097542    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-tkml4_24f04956-ddb1-4c36-a03a-7e9bbd225d64/download-hf-model/0.log"
Jul 01 18:34:44.128834 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.128809    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-rqfmj_c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9/s3-tls-init-serving/0.log"
Jul 01 18:34:44.148822 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.148801    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-rqfmj_c00eb0c9-f2f9-4ebf-82cc-0be1a4570be9/download-hf-model/0.log"
Jul 01 18:34:44.200202 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:44.200158    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-6qdpt_db2e0ca9-ed1b-4a27-9e34-70b36cadd3e4/seaweedfs-tls-custom/0.log"
Jul 01 18:34:45.730233 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:45.730206    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-jdqbf"
Jul 01 18:34:49.478113 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.478087    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/kube-multus-additional-cni-plugins/0.log"
Jul 01 18:34:49.500800 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.500764    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/egress-router-binary-copy/0.log"
Jul 01 18:34:49.520461 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.520429    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/cni-plugins/0.log"
Jul 01 18:34:49.542388 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.542357    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/bond-cni-plugin/0.log"
Jul 01 18:34:49.561995 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.561967    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/routeoverride-cni/0.log"
Jul 01 18:34:49.584465 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.584440    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/whereabouts-cni-bincopy/0.log"
Jul 01 18:34:49.604375 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.604353    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7hj6g_147eec5b-b339-406f-ac6d-466934accd96/whereabouts-cni/0.log"
Jul 01 18:34:49.989429 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:49.989398    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pd8v9_dce5b1ef-d78a-421e-b40b-fc05329403e9/kube-multus/0.log"
Jul 01 18:34:50.064001 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:50.063975    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkpld_c6130bf2-008d-4c26-b82d-7086ec17eb4d/network-metrics-daemon/0.log"
Jul 01 18:34:50.083978 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:50.083891    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkpld_c6130bf2-008d-4c26-b82d-7086ec17eb4d/kube-rbac-proxy/0.log"
Jul 01 18:34:51.209142 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.209112    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-controller/0.log"
Jul 01 18:34:51.225428 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.225402    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/1.log"
Jul 01 18:34:51.225606 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.225457    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovn-acl-logging/0.log"
Jul 01 18:34:51.248295 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.248269    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/kube-rbac-proxy-node/0.log"
Jul 01 18:34:51.272024 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.271993    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 01 18:34:51.290376 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.290340    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/northd/0.log"
Jul 01 18:34:51.317687 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.317664    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/nbdb/0.log"
Jul 01 18:34:51.337593 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.337569    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/sbdb/0.log"
Jul 01 18:34:51.398663 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:51.398628    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrzqw_8c7136be-3fdf-46f2-967b-f08554f849d3/ovnkube-controller/0.log"
Jul 01 18:34:52.439854 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:52.439822    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-c9pdm_acc0c7d0-71a9-4348-8840-1d1c3b94483e/check-endpoints/0.log"
Jul 01 18:34:52.483887 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:52.483857    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tztrj_03c7c0c0-f8a0-471e-8cbc-1513d5299aa6/network-check-target-container/0.log"
Jul 01 18:34:53.537742 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:53.537713    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tg99j_9f561e3a-b03e-4dcf-bcf6-d9c0ce8ea354/iptables-alerter/0.log"
Jul 01 18:34:54.155203 ip-10-0-136-158 kubenswrapper[2555]: I0701 18:34:54.155168    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4xrg4_4fad9a69-9911-4d32-bb4e-7186e4bd40c5/tuned/0.log"