Jul 30 17:00:39.730454 ip-10-0-132-155 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 17:00:40.124488 ip-10-0-132-155 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:00:40.124488 ip-10-0-132-155 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 17:00:40.124488 ip-10-0-132-155 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:00:40.124488 ip-10-0-132-155 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 17:00:40.124488 ip-10-0-132-155 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:00:40.125507 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.125420    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 17:00:40.128936 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128917    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:40.128936 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128936    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128940    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128944    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128946    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128949    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128952    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128955    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128958    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128961    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128963    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128966    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128968    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128971    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128973    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128976    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128978    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128981    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128983    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128986    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128988    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:40.129008 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128994    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128997    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.128999    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129001    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129004    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129006    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129009    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129012    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129015    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129017    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129020    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129023    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129025    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129027    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129030    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129033    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129035    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129038    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129040    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129045    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:40.129494 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129049    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129051    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129054    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129057    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129059    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129062    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129064    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129066    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129069    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129071    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129073    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129076    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129078    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129080    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129084    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129087    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129089    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129092    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129096    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:40.129992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129099    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129102    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129104    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129107    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129109    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129112    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129114    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129117    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129120    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129123    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129126    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129130    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129133    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129136    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129139    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129142    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129144    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129160    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129163    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:40.130473 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129166    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129169    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129171    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129175    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129178    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129180    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129183    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129185    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129188    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129191    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129194    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129196    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129199    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129201    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129204    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129206    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129209    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129212    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129215    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:40.130924 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.129217    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:40.131428 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131416    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:40.131428 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131428    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131432    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131436    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131438    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131442    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131445    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131447    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131450    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131452    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131455    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131459    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131463    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131466    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131469    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131471    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131474    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131477    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131479    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131482    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131485    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:40.131482 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131488    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131491    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131494    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131496    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131500    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131504    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131506    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131509    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131512    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131515    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131517    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131520    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131523    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131526    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131528    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131531    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131533    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131536    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131539    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:40.131967 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131541    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131543    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131546    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131548    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131551    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131554    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131556    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131560    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131562    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131565    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131568    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131570    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131572    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131575    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131577    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131582    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131584    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131587    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131590    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131592    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:40.132448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131595    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131598    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131600    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131603    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131607    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131610    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131613    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131615    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131617    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131620    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131622    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131626    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131628    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131630    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131633    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131636    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131638    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131641    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131643    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131646    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:40.132932 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131648    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131651    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131653    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131655    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131658    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131660    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131663    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131666    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131668    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131671    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131673    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131676    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131679    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131681    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131683    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131686    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131688    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131691    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.131693    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132098    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:40.133424 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132104    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132108    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132111    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132114    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132118    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132120    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132123    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132126    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132128    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132131    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132133    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132136    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132138    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132141    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132143    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132160    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132163    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132165    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132168    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132172    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:40.133902 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132175    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132178    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132181    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132183    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132186    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132188    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132191    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132193    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132196    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132198    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132200    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132203    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132205    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132208    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132210    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132213    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132216    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132219    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132221    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132224    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132227    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:40.134389 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132229    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132232    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132235    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132237    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132239    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132242    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132244    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132247    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132249    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132252    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132255    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132257    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132260    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132263    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132265    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132267    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132270    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132272    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132275    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132277    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:40.134934 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132279    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132282    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132284    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132287    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132289    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132292    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132294    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132296    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132301    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132304    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132307    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132309    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132312    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132314    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132317    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132319    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132321    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132324    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132326    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:40.135421 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132328    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132333    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132337    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132340    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132343    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132346    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132349    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132352    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132355    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132357    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132361    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132364    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132367    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132369    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132372    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132374    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132376    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.132379    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132445    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 17:00:40.135891 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132452    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132458    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132463    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132468    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132471    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132475    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132480    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132483    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132486    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132489    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132493    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132495    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132498    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132501    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132504    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132507    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132510    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132515    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132518    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132521    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132524    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132527    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132531    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 17:00:40.136365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132534    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132537    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132541    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132544    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132547    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132550    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132553    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132556    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132560    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132563    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132566    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132569    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132572    2560 flags.go:64] FLAG: --enable-server="true"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132576    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132580    2560 flags.go:64] FLAG: --event-burst="100"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132583    2560 flags.go:64] FLAG: --event-qps="50"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132586    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132589    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132592    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132595    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132598    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132601    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132604    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132607    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132610    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 17:00:40.136913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132614    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132617    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132620    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132623    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132625    2560 flags.go:64] FLAG: --feature-gates=""
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132629    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132632    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132635    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132638    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132641    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132644    2560 flags.go:64] FLAG: --help="false"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132647    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132650    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132653    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132655    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132659    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132662    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132665    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132668    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132671    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132674    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132679    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132682    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132685    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 30 17:00:40.137539 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132687    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132690    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132693    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132695    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132698    2560 flags.go:64] FLAG: --lock-file=""
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132701    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132704    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132707    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132712    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132715    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132718    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132720    2560 flags.go:64] FLAG: --logging-format="text"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132723    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132726    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132729    2560 flags.go:64] FLAG: --manifest-url=""
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132732    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132736    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132739    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132743    2560 flags.go:64] FLAG: --max-pods="110"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132746    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132749    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132751    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132754    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132757    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132760    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 17:00:40.138144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132762    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132769    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132772    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132775    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132778    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132782    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132787    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132790    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132793    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132796    2560 flags.go:64] FLAG: --port="10250"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132799    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132802    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00df66925d001f1b9"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132804    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132807    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132810    2560 flags.go:64] FLAG: --register-node="true"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132815    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132819    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132822    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132825    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132827    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132831    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132834    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132837    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132840    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132843    2560 flags.go:64] FLAG: --runonce="false"
Jul 30 17:00:40.138826 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132845    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132848    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132851    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132854    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132856    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132859    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132862    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132865    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132867    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132871    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132873    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132876    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132879    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132883    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132886    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132891    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132894    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132896    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132901    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132904    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132906    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132909    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132913    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132916    2560 flags.go:64] FLAG: --v="2"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132925    2560 flags.go:64] FLAG: --version="false"
Jul 30 17:00:40.139457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132929    2560 flags.go:64] FLAG: --vmodule=""
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132933    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.132936    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133052    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133057    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133060    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133063    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133067    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133071    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133074    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133077    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133080    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133083    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133086    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133088    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133091    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133093    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133096    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133098    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133101    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:40.140062 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133103    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133106    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133109    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133111    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133114    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133116    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133119    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133121    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133123    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133128    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133130    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133133    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133135    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133138    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133140    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133143    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133158    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133161    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133164    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:40.140553 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133167    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133169    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133172    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133175    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133177    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133180    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133182    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133185    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133188    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133190    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133193    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133195    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133198    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133200    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133202    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133210    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133213    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133215    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133218    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:40.141005 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133221    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133223    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133226    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133229    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133232    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133234    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133238    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133241    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133244    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133247    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133250    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133252    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133255    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133257    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133260    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133263    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133265    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133268    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133271    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133273    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:40.141497 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133275    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133278    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133282    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133285    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133288    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133290    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133293    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133295    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133299    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133301    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133304    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133306    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133309    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133311    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133314    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133318    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133320    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133323    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133325    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133327    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:40.141975 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133330    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133333    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133335    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.133338    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.133835    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.140604    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.140619    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.141211    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.141222    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141285    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141290    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141294    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141297    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141300    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141303    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:40.142520 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141306    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141309    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141311    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141314    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141317    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141319    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141328    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141331    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141333    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141336    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141339    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141343    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141347    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141350    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141353    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141356    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141359    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141362    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141365    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:40.142901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141368    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141370    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141373    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141375    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141379    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141382    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141384    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141387    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141390    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141392    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141395    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141398    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141401    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141403    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141406    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141408    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141410    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141414    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141417    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141421    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:40.143368 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141426    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141428    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141431    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141433    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141436    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141438    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141441    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141443    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141446    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141448    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141451    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141453    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141456    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141458    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141461    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141464    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141467    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141470    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141473    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:40.143901 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141475    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141478    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141480    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141483    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141485    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141488    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141490    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141492    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141495    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141497    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141501    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141503    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141506    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141508    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141511    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141514    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141517    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141521    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141524    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:40.144433 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141527    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141530    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141532    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141535    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141537    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141540    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141543    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141545    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141548    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141551    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141554    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141556    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141559    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141561    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141564    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:40.144921 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141566    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.141572    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141685    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141690    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141693    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141696    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141699    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141702    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141705    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141708    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141710    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141713    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141716    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141719    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141722    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:40.145317 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141725    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141727    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141729    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141732    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141734    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141737    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141739    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141742    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141744    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141747    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141750    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141753    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141757    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141760    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141763    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141765    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141768    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141771    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141773    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:40.145691 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141776    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141778    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141781    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141783    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141786    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141788    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141791    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141794    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141796    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141798    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141801    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141803    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141809    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141812    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141814    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141817    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141819    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141822    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141824    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141826    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:40.146162 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141829    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141831    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141834    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141837    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141839    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141842    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141844    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141847    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141849    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141852    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141854    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141857    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141859    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141862    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141864    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141867    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141869    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141871    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141874    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:40.146664 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141876    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141880    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141883    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141885    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141888    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141890    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141893    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141895    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141898    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141900    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141903    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141905    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141908    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141910    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141912    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141915    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141917    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141920    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141923    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:40.147177 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141926    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141928    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141931    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141933    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141935    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141938    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141940    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141943    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:40.141946    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.141952    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.142071    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.143962    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.145224    2560 server.go:1019] "Starting client certificate rotation"
Jul 30 17:00:40.147742 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.145321    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 17:00:40.148080 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.145358    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 17:00:40.149773 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.149749    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 17:00:40.151028 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.151008    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 17:00:40.163211 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.163196    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 30 17:00:40.165432 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.165416    2560 log.go:25] "Validated CRI v1 image API"
Jul 30 17:00:40.166920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.166902    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 17:00:40.169975 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.169951    2560 fs.go:135] Filesystem UUIDs: map[6506839e-3420-41aa-9b01-403de7571409:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c0209510-c7af-452c-9b94-a0a971b241ee:/dev/nvme0n1p4]
Jul 30 17:00:40.170029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.169975    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 17:00:40.174010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.173993    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 17:00:40.175632 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.175515    2560 manager.go:216] Machine: {Timestamp:2026-07-30 17:00:40.174026123 +0000 UTC m=+0.327268816 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184764 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29e41c1dd343cced427564c6f18f01 SystemUUID:ec29e41c-1dd3-43cc-ed42-7564c6f18f01 BootID:eb5027bb-25de-4ada-b169-74d4068dbab4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:40:1e:59:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:40:1e:59:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:aa:29:c5:69:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 17:00:40.175632 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.175616    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 17:00:40.175752 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.175698    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 17:00:40.178951 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.178927    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 17:00:40.179109 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.178954    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-155.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 17:00:40.179766 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.179756    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 17:00:40.179804 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.179768    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 17:00:40.179804 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.179780    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 17:00:40.180304 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.180294    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 17:00:40.181401 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.181392    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 17:00:40.182899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.182887    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 17:00:40.183007 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.182998    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 17:00:40.183054 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183028    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 17:00:40.183054 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183045    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 17:00:40.183129 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183060    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 17:00:40.183129 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183069    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 30 17:00:40.183129 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183079    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 17:00:40.183537 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183523    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 17:00:40.183572 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.183549    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 17:00:40.187589 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.187376    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 17:00:40.190657 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.190640    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 17:00:40.190726 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.190672    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 17:00:40.192278 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192266    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192283    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192289    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192296    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192305    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192310    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192319    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192324    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192331    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 17:00:40.192337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192336    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 17:00:40.192567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192344    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 17:00:40.192567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.192350    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 17:00:40.193302 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.193289    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 17:00:40.193302 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.193299    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 17:00:40.196386 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.196366    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6rjb5"
Jul 30 17:00:40.196699 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.196684    2560 server.go:1268] "Started kubelet"
Jul 30 17:00:40.196852 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.196774    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 17:00:40.196913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.196874    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 17:00:40.197335 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.197314    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-155.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 17:00:40.197432 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.197333    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 17:00:40.197432 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.197329    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 17:00:40.197538 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.197426    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 17:00:40.197748 ip-10-0-132-155 systemd[1]: Started Kubernetes Kubelet.
Jul 30 17:00:40.198713 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.198564    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 17:00:40.199578 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.199553    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 17:00:40.202558 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.202538    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 17:00:40.204834 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.204811    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6rjb5"
Jul 30 17:00:40.206197 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206177    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 17:00:40.206275 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206201    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 17:00:40.206390 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.206371    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.206834 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206807    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 17:00:40.206834 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206809    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 17:00:40.206971 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206842    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 17:00:40.206971 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206966    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 17:00:40.207070 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.206978    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 17:00:40.207205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.207186    2560 factory.go:55] Registering systemd factory
Jul 30 17:00:40.207205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.207206    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 30 17:00:40.208839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.207939    2560 factory.go:153] Registering CRI-O factory
Jul 30 17:00:40.208839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.208054    2560 factory.go:223] Registration of the crio container factory successfully
Jul 30 17:00:40.208839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.208207    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 17:00:40.208839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.208234    2560 factory.go:103] Registering Raw factory
Jul 30 17:00:40.208839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.208378    2560 manager.go:1196] Started watching for new ooms in manager
Jul 30 17:00:40.209343 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.209320    2560 manager.go:349] Starting recovery of all containers
Jul 30 17:00:40.212301 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.211340    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-155.ec2.internal.18c71fe3b8f2ea67  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-155.ec2.internal,UID:ip-10-0-132-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-155.ec2.internal,},FirstTimestamp:2026-07-30 17:00:40.196655719 +0000 UTC m=+0.349898411,LastTimestamp:2026-07-30 17:00:40.196655719 +0000 UTC m=+0.349898411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-155.ec2.internal,}"
Jul 30 17:00:40.212424 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.212397    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 17:00:40.212489 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.212423    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 17:00:40.222449 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.222272    2560 manager.go:354] Recovery completed
Jul 30 17:00:40.226960 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.226947    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.228770 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.228747    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.228859 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.228776    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.228859 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.228792    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.229328 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.229308    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 17:00:40.229328 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.229328    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 17:00:40.229414 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.229344    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 17:00:40.229464 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.229446    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.230141 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.230128    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.230236 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.230168    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.230236 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.230183    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.230959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.230945    2560 policy_none.go:49] "None policy: Start"
Jul 30 17:00:40.231021 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.230965    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 17:00:40.231021 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.230978    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 17:00:40.232128 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.232115    2560 policy_none.go:47] "Start"
Jul 30 17:00:40.269771 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.269748    2560 manager.go:337] "Starting Device Plugin manager"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.269781    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.269791    2560 server.go:87] "Starting device plugin registration server"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.270067    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.270086    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.270196    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.270282    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.270292    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.270932    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 17:00:40.280267 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.270989    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.371239 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.371219    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.372238 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.372223    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.372309 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.372253    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.372309 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.372263    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.372309 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.372288    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.380992 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.380935    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.380992 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.380959    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-155.ec2.internal\": node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.383353 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.383330    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 17:00:40.384700 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.384684    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 17:00:40.384817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.384719    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 17:00:40.384817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.384741    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 17:00:40.384817 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.384771    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 17:00:40.387034 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.387019    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:40.394119 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.394091    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.485580 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.485530    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"]
Jul 30 17:00:40.485744 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.485633    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.486643 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.486623    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.486780 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.486661    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.486780 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.486672    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.487897 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.487881    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.488051 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.488114 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488081    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.488730 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488713    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.488730 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488720    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.488845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488740    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.488845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488763    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.488845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488765    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.488845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.488777    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.489870 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.489853    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.489943 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.489876    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:40.490564 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.490543    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:40.490652 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.490592    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:40.490652 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.490608    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:40.494349 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.494143    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.507123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.507101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d017553f8065bce9a646bc78853e1a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal\" (UID: \"1d017553f8065bce9a646bc78853e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.514930 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.514913    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-155.ec2.internal\" not found" node="ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.519583 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.519566    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-155.ec2.internal\" not found" node="ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.594998 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.594972    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.607642 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.607621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41156b961e58c20ae0176ce2b34a408f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-155.ec2.internal\" (UID: \"41156b961e58c20ae0176ce2b34a408f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.607724 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.607655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d017553f8065bce9a646bc78853e1a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal\" (UID: \"1d017553f8065bce9a646bc78853e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.607724 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.607673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d017553f8065bce9a646bc78853e1a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal\" (UID: \"1d017553f8065bce9a646bc78853e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.607724 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.607706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d017553f8065bce9a646bc78853e1a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal\" (UID: \"1d017553f8065bce9a646bc78853e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.696137 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.696072    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.708332 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.708309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d017553f8065bce9a646bc78853e1a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal\" (UID: \"1d017553f8065bce9a646bc78853e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.708380 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.708348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41156b961e58c20ae0176ce2b34a408f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-155.ec2.internal\" (UID: \"41156b961e58c20ae0176ce2b34a408f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.708421 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.708380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41156b961e58c20ae0176ce2b34a408f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-155.ec2.internal\" (UID: \"41156b961e58c20ae0176ce2b34a408f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.708421 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.708409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d017553f8065bce9a646bc78853e1a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal\" (UID: \"1d017553f8065bce9a646bc78853e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.796523 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.796484    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.817935 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.817918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.822752 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:40.822733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:40.896871 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.896833    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:40.997398 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:40.997317    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:41.097839 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:41.097803    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:41.145169 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.145128    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 17:00:41.145747 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:41.145293    2560 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.132.155:53168->54.174.29.144:6443: use of closed network connection"
Jul 30 17:00:41.145747 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.145355    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 17:00:41.145747 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:41.145367    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.132.155:53168->54.174.29.144:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 17:00:41.197907 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:41.197878    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-155.ec2.internal\" not found"
Jul 30 17:00:41.210204 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.210167    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 16:55:39 +0000 UTC" deadline="2028-02-28 03:11:53.146053097 +0000 UTC"
Jul 30 17:00:41.210204 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.210200    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13858h11m11.93585659s"
Jul 30 17:00:41.211914 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.211899    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:41.307298 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.307222    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:41.315587 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.315567    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 17:00:41.317594 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.317580    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal"
Jul 30 17:00:41.326577 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.326563    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 17:00:41.530038 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:41.529989    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41156b961e58c20ae0176ce2b34a408f.slice/crio-090ec1ca11e4a99e8f7b1578c006f1fa02938ff848791ba139e0bccdbf2d3f1e WatchSource:0}: Error finding container 090ec1ca11e4a99e8f7b1578c006f1fa02938ff848791ba139e0bccdbf2d3f1e: Status 404 returned error can't find the container with id 090ec1ca11e4a99e8f7b1578c006f1fa02938ff848791ba139e0bccdbf2d3f1e
Jul 30 17:00:41.534606 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.534589    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:00:41.808509 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:41.808485    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:41.936659 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:41.936635    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d017553f8065bce9a646bc78853e1a3.slice/crio-91c1a57aa7d77b5bfe3793a6c71c57668ae6e5c4141979666867c85f7f79b863 WatchSource:0}: Error finding container 91c1a57aa7d77b5bfe3793a6c71c57668ae6e5c4141979666867c85f7f79b863: Status 404 returned error can't find the container with id 91c1a57aa7d77b5bfe3793a6c71c57668ae6e5c4141979666867c85f7f79b863
Jul 30 17:00:42.183537 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.183450    2560 apiserver.go:52] "Watching apiserver"
Jul 30 17:00:42.189247 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.189227    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 17:00:42.191896 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.191878    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wk2gc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq","openshift-cluster-node-tuning-operator/tuned-cn9nt","openshift-image-registry/node-ca-fr8d6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal","openshift-multus/multus-additional-cni-plugins-72cvr","openshift-multus/multus-vvgrw","openshift-multus/network-metrics-daemon-4pq5s","kube-system/konnectivity-agent-xllkt","kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal","openshift-dns/node-resolver-jqddk","openshift-network-diagnostics/network-check-target-rn786","openshift-network-operator/iptables-alerter-vkq8r","openshift-ovn-kubernetes/ovnkube-node-h4rcq"]
Jul 30 17:00:42.193245 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.193225    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.193330 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.193303    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:42.194562 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.194546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.195460 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.195442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.196340 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.196324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.196551 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.196531    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 17:00:42.196622 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.196602    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8gn2h\""
Jul 30 17:00:42.196672 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.196632    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.196672 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.196664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.197404 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.197389    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.197983 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.197969    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zb8dj\""
Jul 30 17:00:42.198171 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.198137    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.198604 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.198590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.198843 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.198825    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.199108 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199093    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.199339 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199326    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 17:00:42.199414 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199399    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 17:00:42.199463 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199419    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5k4qx\""
Jul 30 17:00:42.199463 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199407    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zc9v7\""
Jul 30 17:00:42.199678 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199665    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.199737 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199724    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 17:00:42.199867 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199854    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.199920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199909    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.199949 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.199918    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 17:00:42.200114 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.200095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.200227 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.200188    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:42.200329 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.200311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 17:00:42.200453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.200439    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xzszr\""
Jul 30 17:00:42.201805 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.201773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.204294 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.203058    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.204294 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.204037    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z245f\""
Jul 30 17:00:42.204645 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.204620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 17:00:42.204720 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.204660    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 17:00:42.204809 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.204792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:42.204887 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.204861    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:42.204959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.204944    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.205161 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.205136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssts6\""
Jul 30 17:00:42.205232 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.205206    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.205901 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.205885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.206656 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.206636    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 17:00:42.207099 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.207083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.208022 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.208005    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 17:00:42.208168 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.208130    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.208313 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.208293    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.208391 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.208326    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9xfn\""
Jul 30 17:00:42.209282 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209177    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 17:00:42.209282 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209192    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 17:00:42.209282 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209215    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c84tb\""
Jul 30 17:00:42.209520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209502    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 17:00:42.209603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209529    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 17:00:42.209603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209540    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 17:00:42.209603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.209540    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 17:00:42.215905 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.215890    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 17:00:42.216525 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-socket-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.216636 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-os-release\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.216636 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-etc-kubernetes\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.216636 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-slash\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.216636 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.216636 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tgh\" (UniqueName: \"kubernetes.io/projected/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-kube-api-access-98tgh\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.216817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfkl\" (UniqueName: \"kubernetes.io/projected/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-kube-api-access-ktfkl\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.216817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cf5a606-6180-4279-944f-2c7ea8276166-host-slash\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.216817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.216817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-tuned\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.216817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-serviceca\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.216817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-device-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-systemd-units\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-systemd\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-kubelet\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-host\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.216992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-host\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.217038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysctl-d\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-system-cni-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-cni-multus\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-daemon-config\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-run-netns\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovn-node-metrics-cert\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-systemd\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-hostroot\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-conf-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-log-socket\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkhl\" (UniqueName: \"kubernetes.io/projected/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-kube-api-access-krkhl\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-cnibin\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snt8q\" (UniqueName: \"kubernetes.io/projected/9cf5a606-6180-4279-944f-2c7ea8276166-kube-api-access-snt8q\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.217407 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-node-log\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-cni-netd\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-modprobe-d\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-run\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sdqt\" (UniqueName: \"kubernetes.io/projected/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-kube-api-access-9sdqt\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-multus-certs\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9cf5a606-6180-4279-944f-2c7ea8276166-iptables-alerter-script\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c22ffce-59f6-4289-b6e9-1f53daab03fa-hosts-file\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-ovn\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovnkube-config\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysconfig\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-kubernetes\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-cni-bin\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c27lw\" (UniqueName: \"kubernetes.io/projected/ff5e9431-9a26-445d-a7cd-758206dc3dd3-kube-api-access-c27lw\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c22ffce-59f6-4289-b6e9-1f53daab03fa-tmp-dir\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.217868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovnkube-script-lib\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-cni-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-env-overrides\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-netns\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-sys-fs\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbe285af-ddd9-4852-bd70-a7f439198e83-konnectivity-ca\") pod \"konnectivity-agent-xllkt\" (UID: \"cbe285af-ddd9-4852-bd70-a7f439198e83\") " pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tftb\" (UniqueName: \"kubernetes.io/projected/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-kube-api-access-4tftb\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-os-release\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff5e9431-9a26-445d-a7cd-758206dc3dd3-cni-binary-copy\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-dbus\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbe285af-ddd9-4852-bd70-a7f439198e83-agent-certs\") pod \"konnectivity-agent-xllkt\" (UID: \"cbe285af-ddd9-4852-bd70-a7f439198e83\") " pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-var-lib-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.218348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.217995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-system-cni-dir\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-socket-dir-parent\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-kubelet\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-kubelet-config\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjww2\" (UniqueName: \"kubernetes.io/projected/8c22ffce-59f6-4289-b6e9-1f53daab03fa-kube-api-access-tjww2\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-etc-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-lib-modules\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-var-lib-kubelet\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-k8s-cni-cncf-io\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xrg\" (UniqueName: \"kubernetes.io/projected/577eeeef-89e9-40d3-a95c-0f80bef10fdc-kube-api-access-w7xrg\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-cni-bin\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysctl-conf\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-sys\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-tmp\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cnibin\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cni-binary-copy\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.218758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.218303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-registration-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.247556 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.247536    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jp4sn"
Jul 30 17:00:42.257734 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.257712    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jp4sn"
Jul 30 17:00:42.307413 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.307383    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 17:00:42.318582 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff5e9431-9a26-445d-a7cd-758206dc3dd3-cni-binary-copy\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-dbus\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbe285af-ddd9-4852-bd70-a7f439198e83-agent-certs\") pod \"konnectivity-agent-xllkt\" (UID: \"cbe285af-ddd9-4852-bd70-a7f439198e83\") " pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-var-lib-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-system-cni-dir\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-socket-dir-parent\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-kubelet\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-kubelet-config\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.318718 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-var-lib-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-system-cni-dir\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjww2\" (UniqueName: \"kubernetes.io/projected/8c22ffce-59f6-4289-b6e9-1f53daab03fa-kube-api-access-tjww2\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-socket-dir-parent\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-etc-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-kubelet-config\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-kubelet\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-etc-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-dbus\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-lib-modules\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-var-lib-kubelet\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-k8s-cni-cncf-io\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xrg\" (UniqueName: \"kubernetes.io/projected/577eeeef-89e9-40d3-a95c-0f80bef10fdc-kube-api-access-w7xrg\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-var-lib-kubelet\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-lib-modules\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-cni-bin\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319016    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.318995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-k8s-cni-cncf-io\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.319048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysctl-conf\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-cni-bin\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-sys\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-tmp\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysctl-conf\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cnibin\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-sys\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff5e9431-9a26-445d-a7cd-758206dc3dd3-cni-binary-copy\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cni-binary-copy\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-registration-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cnibin\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-socket-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-registration-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-os-release\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-os-release\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-etc-kubernetes\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-slash\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.319681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-socket-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tgh\" (UniqueName: \"kubernetes.io/projected/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-kube-api-access-98tgh\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-etc-kubernetes\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfkl\" (UniqueName: \"kubernetes.io/projected/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-kube-api-access-ktfkl\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cf5a606-6180-4279-944f-2c7ea8276166-host-slash\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-tuned\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-serviceca\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-device-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cni-binary-copy\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-systemd-units\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9cf5a606-6180-4279-944f-2c7ea8276166-host-slash\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-systemd\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.320481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-systemd\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-kubelet\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-host\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-host\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysctl-d\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-system-cni-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-device-dir\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-cni-multus\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-daemon-config\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-run-netns\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.319951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovn-node-metrics-cert\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.320036    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-host\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-serviceca\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.320102    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:00:42.820083356 +0000 UTC m=+2.973326039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:42.321202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-systemd\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-host\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-run-netns\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-systemd-units\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-kubelet\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-hostroot\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-conf-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-log-socket\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkhl\" (UniqueName: \"kubernetes.io/projected/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-kube-api-access-krkhl\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-hostroot\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-log-socket\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-conf-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-system-cni-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysctl-d\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-daemon-config\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-cni-multus\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.321913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-slash\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-cnibin\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snt8q\" (UniqueName: \"kubernetes.io/projected/9cf5a606-6180-4279-944f-2c7ea8276166-kube-api-access-snt8q\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-cnibin\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-node-log\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-node-log\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.320997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-cni-netd\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321024    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-cni-netd\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-modprobe-d\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-run\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sdqt\" (UniqueName: \"kubernetes.io/projected/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-kube-api-access-9sdqt\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-multus-certs\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9cf5a606-6180-4279-944f-2c7ea8276166-iptables-alerter-script\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c22ffce-59f6-4289-b6e9-1f53daab03fa-hosts-file\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-ovn\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-run\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovnkube-config\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.322651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysconfig\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-kubernetes\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-cni-bin\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c27lw\" (UniqueName: \"kubernetes.io/projected/ff5e9431-9a26-445d-a7cd-758206dc3dd3-kube-api-access-c27lw\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-modprobe-d\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c22ffce-59f6-4289-b6e9-1f53daab03fa-tmp-dir\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-ovn\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovnkube-script-lib\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-multus-certs\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-cni-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-env-overrides\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-netns\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-sys-fs\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbe285af-ddd9-4852-bd70-a7f439198e83-konnectivity-ca\") pod \"konnectivity-agent-xllkt\" (UID: \"cbe285af-ddd9-4852-bd70-a7f439198e83\") " pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tftb\" (UniqueName: \"kubernetes.io/projected/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-kube-api-access-4tftb\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-os-release\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-os-release\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovnkube-config\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.321987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-multus-cni-dir\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-sysconfig\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-kubernetes\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9cf5a606-6180-4279-944f-2c7ea8276166-iptables-alerter-script\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c22ffce-59f6-4289-b6e9-1f53daab03fa-hosts-file\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-var-lib-cni-bin\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c22ffce-59f6-4289-b6e9-1f53daab03fa-tmp-dir\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/577eeeef-89e9-40d3-a95c-0f80bef10fdc-sys-fs\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-run-openvswitch\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.323923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-env-overrides\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5e9431-9a26-445d-a7cd-758206dc3dd3-host-run-netns\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-tuned\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.322551    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-etc-systemd\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.322605    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:00:42.822589855 +0000 UTC m=+2.975832537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovnkube-script-lib\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-tmp\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbe285af-ddd9-4852-bd70-a7f439198e83-agent-certs\") pod \"konnectivity-agent-xllkt\" (UID: \"cbe285af-ddd9-4852-bd70-a7f439198e83\") " pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-ovn-node-metrics-cert\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.324541 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.322961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbe285af-ddd9-4852-bd70-a7f439198e83-konnectivity-ca\") pod \"konnectivity-agent-xllkt\" (UID: \"cbe285af-ddd9-4852-bd70-a7f439198e83\") " pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.328692 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.328655    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:42.328692 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.328678    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:42.328692 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.328693    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:42.329091 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.328755    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:00:42.828740155 +0000 UTC m=+2.981982851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:42.330496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.330445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjww2\" (UniqueName: \"kubernetes.io/projected/8c22ffce-59f6-4289-b6e9-1f53daab03fa-kube-api-access-tjww2\") pod \"node-resolver-jqddk\" (UID: \"8c22ffce-59f6-4289-b6e9-1f53daab03fa\") " pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.331006 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.330983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xrg\" (UniqueName: \"kubernetes.io/projected/577eeeef-89e9-40d3-a95c-0f80bef10fdc-kube-api-access-w7xrg\") pod \"aws-ebs-csi-driver-node-dsjwq\" (UID: \"577eeeef-89e9-40d3-a95c-0f80bef10fdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.331378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.331358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tgh\" (UniqueName: \"kubernetes.io/projected/5f8c5cb7-3ff4-419f-b3ed-446b21804bca-kube-api-access-98tgh\") pod \"node-ca-fr8d6\" (UID: \"5f8c5cb7-3ff4-419f-b3ed-446b21804bca\") " pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.331465 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.331404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tftb\" (UniqueName: \"kubernetes.io/projected/cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03-kube-api-access-4tftb\") pod \"multus-additional-cni-plugins-72cvr\" (UID: \"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03\") " pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.331624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.331606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfkl\" (UniqueName: \"kubernetes.io/projected/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-kube-api-access-ktfkl\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.331658 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.331643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c27lw\" (UniqueName: \"kubernetes.io/projected/ff5e9431-9a26-445d-a7cd-758206dc3dd3-kube-api-access-c27lw\") pod \"multus-vvgrw\" (UID: \"ff5e9431-9a26-445d-a7cd-758206dc3dd3\") " pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.331929 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.331913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sdqt\" (UniqueName: \"kubernetes.io/projected/6b0fcb6c-0b49-42a2-a9e2-5062284c34c4-kube-api-access-9sdqt\") pod \"tuned-cn9nt\" (UID: \"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4\") " pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.331965 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.331931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkhl\" (UniqueName: \"kubernetes.io/projected/ae892c7f-49c2-4d20-bc9a-68d7941bbc1c-kube-api-access-krkhl\") pod \"ovnkube-node-h4rcq\" (UID: \"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.332917 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.332902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snt8q\" (UniqueName: \"kubernetes.io/projected/9cf5a606-6180-4279-944f-2c7ea8276166-kube-api-access-snt8q\") pod \"iptables-alerter-vkq8r\" (UID: \"9cf5a606-6180-4279-944f-2c7ea8276166\") " pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.388774 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.388733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal" event={"ID":"1d017553f8065bce9a646bc78853e1a3","Type":"ContainerStarted","Data":"91c1a57aa7d77b5bfe3793a6c71c57668ae6e5c4141979666867c85f7f79b863"}
Jul 30 17:00:42.389631 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.389610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal" event={"ID":"41156b961e58c20ae0176ce2b34a408f","Type":"ContainerStarted","Data":"090ec1ca11e4a99e8f7b1578c006f1fa02938ff848791ba139e0bccdbf2d3f1e"}
Jul 30 17:00:42.505784 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.505703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq"
Jul 30 17:00:42.511423 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.511358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cn9nt"
Jul 30 17:00:42.513468 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.513443    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577eeeef_89e9_40d3_a95c_0f80bef10fdc.slice/crio-a3b1647786c229c5d8e5ff87cd5d970c0d490c015193a1751d0e4fc5fdaafdbc WatchSource:0}: Error finding container a3b1647786c229c5d8e5ff87cd5d970c0d490c015193a1751d0e4fc5fdaafdbc: Status 404 returned error can't find the container with id a3b1647786c229c5d8e5ff87cd5d970c0d490c015193a1751d0e4fc5fdaafdbc
Jul 30 17:00:42.517575 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.517397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fr8d6"
Jul 30 17:00:42.518920 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.518900    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0fcb6c_0b49_42a2_a9e2_5062284c34c4.slice/crio-15a2380c8c0456225608ee432ea6ebb68756773716ded21fbdb4265f874c7786 WatchSource:0}: Error finding container 15a2380c8c0456225608ee432ea6ebb68756773716ded21fbdb4265f874c7786: Status 404 returned error can't find the container with id 15a2380c8c0456225608ee432ea6ebb68756773716ded21fbdb4265f874c7786
Jul 30 17:00:42.521507 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.521477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-72cvr"
Jul 30 17:00:42.525998 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.525974    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8c5cb7_3ff4_419f_b3ed_446b21804bca.slice/crio-d415f7098ddf216e2849b447710a634a300be71916a717db672088d1f7b1c023 WatchSource:0}: Error finding container d415f7098ddf216e2849b447710a634a300be71916a717db672088d1f7b1c023: Status 404 returned error can't find the container with id d415f7098ddf216e2849b447710a634a300be71916a717db672088d1f7b1c023
Jul 30 17:00:42.526077 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.526055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvgrw"
Jul 30 17:00:42.528716 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.528691    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfe8f1f_427a_4a2b_9f7f_ac8a7ca3be03.slice/crio-3375a69b9cc819512f6d3d22915f259533ebaf35287d38ddc864751b88f35667 WatchSource:0}: Error finding container 3375a69b9cc819512f6d3d22915f259533ebaf35287d38ddc864751b88f35667: Status 404 returned error can't find the container with id 3375a69b9cc819512f6d3d22915f259533ebaf35287d38ddc864751b88f35667
Jul 30 17:00:42.532663 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.532645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:00:42.533379 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.533363    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5e9431_9a26_445d_a7cd_758206dc3dd3.slice/crio-6bf9bcca4d5a8d9960f8d07cc55fc45da2f8b53b619c6fad6f14ffb8274d7687 WatchSource:0}: Error finding container 6bf9bcca4d5a8d9960f8d07cc55fc45da2f8b53b619c6fad6f14ffb8274d7687: Status 404 returned error can't find the container with id 6bf9bcca4d5a8d9960f8d07cc55fc45da2f8b53b619c6fad6f14ffb8274d7687
Jul 30 17:00:42.536409 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.536391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqddk"
Jul 30 17:00:42.540846 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.540826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe285af_ddd9_4852_bd70_a7f439198e83.slice/crio-942201ffcb013c07cfe421ea19c094c5b8872a864919972d4d9d0a13b37d7ea4 WatchSource:0}: Error finding container 942201ffcb013c07cfe421ea19c094c5b8872a864919972d4d9d0a13b37d7ea4: Status 404 returned error can't find the container with id 942201ffcb013c07cfe421ea19c094c5b8872a864919972d4d9d0a13b37d7ea4
Jul 30 17:00:42.542257 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.542240    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vkq8r"
Jul 30 17:00:42.544944 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.543688    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c22ffce_59f6_4289_b6e9_1f53daab03fa.slice/crio-a2aea78c44a5c8c0417d74aa6c00ce5876404843630f0bf74c1ff16faae3b388 WatchSource:0}: Error finding container a2aea78c44a5c8c0417d74aa6c00ce5876404843630f0bf74c1ff16faae3b388: Status 404 returned error can't find the container with id a2aea78c44a5c8c0417d74aa6c00ce5876404843630f0bf74c1ff16faae3b388
Jul 30 17:00:42.546209 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.546189    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:00:42.551256 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.551235    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf5a606_6180_4279_944f_2c7ea8276166.slice/crio-377e0d8fb4fd547c0fc53a83831ec5d604931374865b8d5dcfbfad91f790c3f8 WatchSource:0}: Error finding container 377e0d8fb4fd547c0fc53a83831ec5d604931374865b8d5dcfbfad91f790c3f8: Status 404 returned error can't find the container with id 377e0d8fb4fd547c0fc53a83831ec5d604931374865b8d5dcfbfad91f790c3f8
Jul 30 17:00:42.553101 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:00:42.553086    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae892c7f_49c2_4d20_bc9a_68d7941bbc1c.slice/crio-3aa96337f90993ef6d044604bf4eab567a71f07ec3fd7f674d7187bb67ca9892 WatchSource:0}: Error finding container 3aa96337f90993ef6d044604bf4eab567a71f07ec3fd7f674d7187bb67ca9892: Status 404 returned error can't find the container with id 3aa96337f90993ef6d044604bf4eab567a71f07ec3fd7f674d7187bb67ca9892
Jul 30 17:00:42.724032 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.724006    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:42.824504 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.824427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:42.824504 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.824496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:42.824675 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.824613    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:42.824675 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.824664    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:00:43.824648646 +0000 UTC m=+3.977891327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:42.825036 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.825013    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:42.825220 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.825074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:00:43.825049852 +0000 UTC m=+3.978292534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:42.924796 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:42.924756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:42.924942 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.924928    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:42.924995 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.924944    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:42.924995 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.924955    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:42.925120 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:42.925006    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:00:43.924988816 +0000 UTC m=+4.078231498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:43.260080 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.259888    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 16:55:41 +0000 UTC" deadline="2028-02-25 02:01:34.304600324 +0000 UTC"
Jul 30 17:00:43.260080 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.259980    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13785h0m51.044625562s"
Jul 30 17:00:43.407537 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.407416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq" event={"ID":"577eeeef-89e9-40d3-a95c-0f80bef10fdc","Type":"ContainerStarted","Data":"a3b1647786c229c5d8e5ff87cd5d970c0d490c015193a1751d0e4fc5fdaafdbc"}
Jul 30 17:00:43.420685 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.420649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqddk" event={"ID":"8c22ffce-59f6-4289-b6e9-1f53daab03fa","Type":"ContainerStarted","Data":"a2aea78c44a5c8c0417d74aa6c00ce5876404843630f0bf74c1ff16faae3b388"}
Jul 30 17:00:43.428685 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.428634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fr8d6" event={"ID":"5f8c5cb7-3ff4-419f-b3ed-446b21804bca","Type":"ContainerStarted","Data":"d415f7098ddf216e2849b447710a634a300be71916a717db672088d1f7b1c023"}
Jul 30 17:00:43.434844 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.434762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cn9nt" event={"ID":"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4","Type":"ContainerStarted","Data":"15a2380c8c0456225608ee432ea6ebb68756773716ded21fbdb4265f874c7786"}
Jul 30 17:00:43.437875 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.437850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"3aa96337f90993ef6d044604bf4eab567a71f07ec3fd7f674d7187bb67ca9892"}
Jul 30 17:00:43.440416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.440393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vkq8r" event={"ID":"9cf5a606-6180-4279-944f-2c7ea8276166","Type":"ContainerStarted","Data":"377e0d8fb4fd547c0fc53a83831ec5d604931374865b8d5dcfbfad91f790c3f8"}
Jul 30 17:00:43.452299 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.452272    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xllkt" event={"ID":"cbe285af-ddd9-4852-bd70-a7f439198e83","Type":"ContainerStarted","Data":"942201ffcb013c07cfe421ea19c094c5b8872a864919972d4d9d0a13b37d7ea4"}
Jul 30 17:00:43.461540 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.461511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvgrw" event={"ID":"ff5e9431-9a26-445d-a7cd-758206dc3dd3","Type":"ContainerStarted","Data":"6bf9bcca4d5a8d9960f8d07cc55fc45da2f8b53b619c6fad6f14ffb8274d7687"}
Jul 30 17:00:43.468619 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.468590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerStarted","Data":"3375a69b9cc819512f6d3d22915f259533ebaf35287d38ddc864751b88f35667"}
Jul 30 17:00:43.738421 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.737973    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:43.836520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.833224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:43.836520 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.833300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:43.836520 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.833452    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:43.836520 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.833507    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:00:45.833491556 +0000 UTC m=+5.986734237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:43.836520 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.833845    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:43.836520 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.833885    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:00:45.833873456 +0000 UTC m=+5.987116140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:43.934281 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:43.934250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:43.934444 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.934417    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:43.934444 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.934434    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:43.934444 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.934445    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:43.934571 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:43.934499    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:00:45.934480252 +0000 UTC m=+6.087722935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:44.260961 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:44.260929    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 16:55:41 +0000 UTC" deadline="2028-01-20 16:52:19.800382107 +0000 UTC"
Jul 30 17:00:44.260961 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:44.260959    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12935h51m35.539426894s"
Jul 30 17:00:44.385225 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:44.385196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:44.385383 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:44.385209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:44.385383 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:44.385318    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:44.385383 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:44.385330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:44.385509 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:44.385417    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:44.385561 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:44.385525    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:45.850226 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:45.850188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:45.850758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:45.850269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:45.850758 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.850420    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:45.850758 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.850459    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:45.850758 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.850497    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:00:49.850476249 +0000 UTC m=+10.003718946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:45.850758 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.850531    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:00:49.850509678 +0000 UTC m=+10.003752358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:45.951468 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:45.951430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:45.951669 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.951637    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:45.951669 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.951660    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:45.951782 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.951673    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:45.952166 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:45.952126    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:00:49.952099996 +0000 UTC m=+10.105342682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:46.385852 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:46.385802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:46.386034 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:46.385946    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:46.386536 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:46.386266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:46.386536 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:46.385802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:46.386536 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:46.386381    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:46.386536 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:46.386499    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:48.387453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:48.387421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:48.387902 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:48.387530    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:48.387902 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:48.387851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:48.388030 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:48.387950    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:48.388030 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:48.387991    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:48.388131 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:48.388059    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:49.883800 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:49.883368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:49.883800 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.883599    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:49.883800 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.883665    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.883644108 +0000 UTC m=+18.036886801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:49.883800 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.883666    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:49.883800 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.883718    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.8836996 +0000 UTC m=+18.036942282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:49.883800 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:49.883606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:49.984883 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:49.984847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:49.985075 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.985048    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:49.985075 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.985063    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:49.985075 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.985071    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:49.985261 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:49.985111    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.985098634 +0000 UTC m=+18.138341315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:50.386588 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:50.386561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:50.386741 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:50.386683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:50.386741 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:50.386685    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:50.386741 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:50.386711    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:50.386914 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:50.386846    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:50.387007 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:50.386960    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:52.385563 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:52.385474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:52.385563 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:52.385521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:52.386069 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:52.385476    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:52.386069 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:52.385609    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:52.386069 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:52.385711    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:52.386069 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:52.385789    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:54.385488 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:54.385453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:54.385936 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:54.385457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:54.385936 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:54.385464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:54.385936 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:54.385597    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:54.385936 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:54.385684    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:54.385936 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:54.385768    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:56.385863 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:56.385684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:56.385863 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:56.385684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:56.385863 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:56.385813    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:56.385863 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:56.385828    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:56.386440 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:56.385940    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:56.386440 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:56.386025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:00:57.943077 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:57.943041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:57.943535 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:57.943091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:57.943535 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:57.943210    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:57.943535 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:57.943209    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:57.943535 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:57.943265    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:01:13.943249039 +0000 UTC m=+34.096491721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:57.943535 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:57.943279    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:01:13.943271299 +0000 UTC m=+34.096513980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:58.044417 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:58.044374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:58.044571 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.044547    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:58.044571 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.044570    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:58.044643 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.044580    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:58.044643 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.044635    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:01:14.044618476 +0000 UTC m=+34.197861157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:58.385682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:58.385599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:00:58.385682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:58.385613    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:00:58.385896 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.385746    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:00:58.385896 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:00:58.385795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:00:58.385896 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.385885    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:00:58.386014 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:00:58.385972    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:00.386025 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:00.385985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:00.386526 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:00.386105    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:00.386526 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:00.386132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:00.386526 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:00.386226    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:00.386526 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:00.386107    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:00.386526 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:00.386312    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:02.384957 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:02.384925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:02.384957 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:02.384956    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:02.385382 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:02.385029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:02.385382 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:02.385035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:02.385382 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:02.385084    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:02.385382 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:02.385144    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:03.511717 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.511372    2560 generic.go:356] "Generic (PLEG): container finished" podID="1d017553f8065bce9a646bc78853e1a3" containerID="af100fb6a55dada96637e029aadfb8a2f146a5c1a9cb868fdc55e18751fcdd86" exitCode=0
Jul 30 17:01:03.512744 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.511453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal" event={"ID":"1d017553f8065bce9a646bc78853e1a3","Type":"ContainerDied","Data":"af100fb6a55dada96637e029aadfb8a2f146a5c1a9cb868fdc55e18751fcdd86"}
Jul 30 17:01:03.516910 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.516882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal" event={"ID":"41156b961e58c20ae0176ce2b34a408f","Type":"ContainerStarted","Data":"a61de990a69b367039f57f4e97c0876256bf07578c9fd9360507b40dbbda4a68"}
Jul 30 17:01:03.519946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.519926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"12a29a5df6fb529ae88658a555267d3dc5cce423eb7a029be75a8958fd1cff82"}
Jul 30 17:01:03.520051 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.519985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"7e25950b559d0de425d895179707dba88a279e683e95a19e6b1df1e6b300b4f3"}
Jul 30 17:01:03.520051 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.520028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"9cfc0124503f890c4d7f78747f33834a7c4b417a0651bb07dee41ee1adaf2da7"}
Jul 30 17:01:03.520178 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.520072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"ab608c2377a8c6531c213f9bec3c16abbe55263d237741e994b4294fc726be01"}
Jul 30 17:01:03.520178 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.520109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"60fca32ef677b171099803eeb5f6791ce2a20718961dfc5de18ddccf7699687f"}
Jul 30 17:01:03.520178 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.520144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"431fda6a49118f16eabca1f753a542cfe2f0befc26bd68c59f2cc21300d94579"}
Jul 30 17:01:03.521285 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.521267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xllkt" event={"ID":"cbe285af-ddd9-4852-bd70-a7f439198e83","Type":"ContainerStarted","Data":"e81b3725b1c26477fb0d1efacb3fcbb079366c584c0f0a28684df5d237b2c859"}
Jul 30 17:01:03.522568 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.522547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvgrw" event={"ID":"ff5e9431-9a26-445d-a7cd-758206dc3dd3","Type":"ContainerStarted","Data":"d478f8ec45abb2c64d8088d7eca81c8224ddf4410a98d4881e444d62f0ad9920"}
Jul 30 17:01:03.523935 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.523913    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03" containerID="c702c83969f57e81af4dc61bd3bb91744cfd0293153f67c6094756d98617d6ce" exitCode=0
Jul 30 17:01:03.524028 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.523972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerDied","Data":"c702c83969f57e81af4dc61bd3bb91744cfd0293153f67c6094756d98617d6ce"}
Jul 30 17:01:03.525475 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.525457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq" event={"ID":"577eeeef-89e9-40d3-a95c-0f80bef10fdc","Type":"ContainerStarted","Data":"527ed402440c2507a448648d56e2db22382246dd460c2bd53fd74eb8cd75b3ce"}
Jul 30 17:01:03.526796 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.526774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqddk" event={"ID":"8c22ffce-59f6-4289-b6e9-1f53daab03fa","Type":"ContainerStarted","Data":"dff1ced0f026c2c5e9c3d1292eb1176e7d44e2acd656c5ad5953dbe8f56ae026"}
Jul 30 17:01:03.528537 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.528494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fr8d6" event={"ID":"5f8c5cb7-3ff4-419f-b3ed-446b21804bca","Type":"ContainerStarted","Data":"06daf6879db9a578b4e4b31fc4634226ccf0c5622e1c9fdacbffc720d713b821"}
Jul 30 17:01:03.530100 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.530076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cn9nt" event={"ID":"6b0fcb6c-0b49-42a2-a9e2-5062284c34c4","Type":"ContainerStarted","Data":"f265d68ee75a7dff6501474148a0e49a0012ae68ebc9bddf0734924fa7ae4783"}
Jul 30 17:01:03.544660 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.544605    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xllkt" podStartSLOduration=3.492317755 podStartE2EDuration="23.544591753s" totalImagesPullingTime="20.052273998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.544479722 +0000 UTC m=+23.697722424" watchObservedRunningTime="2026-07-30 17:01:03.544591753 +0000 UTC m=+23.697834450"
Jul 30 17:01:03.559752 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.559704    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jqddk" podStartSLOduration=3.512859676 podStartE2EDuration="23.559689208s" totalImagesPullingTime="20.046829532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.558988559 +0000 UTC m=+23.712231274" watchObservedRunningTime="2026-07-30 17:01:03.559689208 +0000 UTC m=+23.712931911"
Jul 30 17:01:03.573503 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.573384    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fr8d6" podStartSLOduration=3.506430405 podStartE2EDuration="23.573363674s" totalImagesPullingTime="20.066933269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.572349099 +0000 UTC m=+23.725591803" watchObservedRunningTime="2026-07-30 17:01:03.573363674 +0000 UTC m=+23.726606379"
Jul 30 17:01:03.588076 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.588025    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vvgrw" podStartSLOduration=3.435596618 podStartE2EDuration="23.588011079s" totalImagesPullingTime="20.152414461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.587958052 +0000 UTC m=+23.741200756" watchObservedRunningTime="2026-07-30 17:01:03.588011079 +0000 UTC m=+23.741253776"
Jul 30 17:01:03.601624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.601570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-155.ec2.internal" podStartSLOduration=23.6015559 podStartE2EDuration="23.6015559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.601202222 +0000 UTC m=+23.754444942" watchObservedRunningTime="2026-07-30 17:01:03.6015559 +0000 UTC m=+23.754798602"
Jul 30 17:01:03.636780 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.636738    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cn9nt" podStartSLOduration=3.520272819 podStartE2EDuration="23.636722123s" totalImagesPullingTime="20.116449304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.636628504 +0000 UTC m=+23.789871217" watchObservedRunningTime="2026-07-30 17:01:03.636722123 +0000 UTC m=+23.789964825"
Jul 30 17:01:03.687502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.687453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:03.769771 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.769739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:03.820755 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:03.820720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:04.385274 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.385250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:04.385391 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.385250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:04.385391 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.385388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:04.385498 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:04.385381    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:04.385498 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:04.385460    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:04.385597 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:04.385539    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:04.396612 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.396584    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 17:01:04.435706 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.435673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:04.504535 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.504499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:04.534009 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.533972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal" event={"ID":"1d017553f8065bce9a646bc78853e1a3","Type":"ContainerStarted","Data":"cdba09fb16bbfcfacc0c5098a347c4904484d19ddb989a1f3515df33c72fd88c"}
Jul 30 17:01:04.535606 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.535578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vkq8r" event={"ID":"9cf5a606-6180-4279-944f-2c7ea8276166","Type":"ContainerStarted","Data":"728a7458c8a0e3df53c7436389581acbddd169ab039a897b1c4d74437de3a648"}
Jul 30 17:01:04.538259 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.537684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq" event={"ID":"577eeeef-89e9-40d3-a95c-0f80bef10fdc","Type":"ContainerStarted","Data":"575ea21d5e6deb0858f0f74b8981e762a40ced68694cc71e34aeb562f05046ab"}
Jul 30 17:01:04.548034 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.548010    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:01:04.548597 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.548578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:01:04.549843 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.549801    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-155.ec2.internal" podStartSLOduration=24.549789483 podStartE2EDuration="24.549789483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:04.549521556 +0000 UTC m=+24.702764259" watchObservedRunningTime="2026-07-30 17:01:04.549789483 +0000 UTC m=+24.703032187"
Jul 30 17:01:04.567778 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.567732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:04.577457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.577375    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vkq8r" podStartSLOduration=4.491764029 podStartE2EDuration="24.577361764s" totalImagesPullingTime="20.085597735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:04.576943109 +0000 UTC m=+24.730185814" watchObservedRunningTime="2026-07-30 17:01:04.577361764 +0000 UTC m=+24.730604512"
Jul 30 17:01:04.721954 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.721917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:04.787729 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:04.787691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:05.285836 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:05.285735    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T17:01:04.39660601Z","UUID":"16ba7d5c-9973-4da6-a215-4ca8ad7e79c8","Handler":null,"Name":"","Endpoint":""}
Jul 30 17:01:05.287614 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:05.287590    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 17:01:05.287748 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:05.287644    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 17:01:05.540306 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:05.540242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:01:05.540751 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:05.540736    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xllkt"
Jul 30 17:01:05.608263 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:05.608233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:06.385238 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:06.385209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:06.385238 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:06.385237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:06.385446 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:06.385211    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:06.385446 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:06.385335    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:06.385446 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:06.385418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:06.385561 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:06.385469    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:06.546169 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:06.546062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"1ae40ee4669e47586ff8e4446d79fefb4dd5559ddfce7cc0a6350b328cc9ee7d"}
Jul 30 17:01:08.385188 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.385134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:08.385188 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.385186    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:08.385878 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.385140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:08.385878 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:08.385285    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:08.385878 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:08.385352    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:08.385878 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:08.385404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:08.558915 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.558830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" event={"ID":"ae892c7f-49c2-4d20-bc9a-68d7941bbc1c","Type":"ContainerStarted","Data":"1ced4a1bdf07c9fd3e664db95dfa50aa2db3d6441db0c3f8c479d12f047f8e47"}
Jul 30 17:01:08.559111 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.559084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:01:08.560679 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.560650    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03" containerID="273b7d49a2784e119ced9cc410ff11ac6890a209f79ce717c9c31a27b31ae2f0" exitCode=0
Jul 30 17:01:08.560786 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.560715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerDied","Data":"273b7d49a2784e119ced9cc410ff11ac6890a209f79ce717c9c31a27b31ae2f0"}
Jul 30 17:01:08.562860 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.562827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq" event={"ID":"577eeeef-89e9-40d3-a95c-0f80bef10fdc","Type":"ContainerStarted","Data":"75ab70b5f786bd15fa2f25f4473149a3a42d534cefa33a6cc7a5e896443f97bf"}
Jul 30 17:01:08.576078 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.576057    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:01:08.584732 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.584693    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq" podStartSLOduration=8.429982504 podStartE2EDuration="28.584678758s" totalImagesPullingTime="20.154696254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:08.584062764 +0000 UTC m=+28.737305495" watchObservedRunningTime="2026-07-30 17:01:08.584678758 +0000 UTC m=+28.737921460"
Jul 30 17:01:08.647602 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:08.647547    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dsjwq" podStartSLOduration=3.983367486 podStartE2EDuration="28.647522336s" totalImagesPullingTime="24.66415485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:08.646897039 +0000 UTC m=+28.800139742" watchObservedRunningTime="2026-07-30 17:01:08.647522336 +0000 UTC m=+28.800765033"
Jul 30 17:01:09.565506 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.565475    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:01:09.566041 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.565864    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:01:09.582495 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.582465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:01:09.975839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.975542    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wk2gc"]
Jul 30 17:01:09.976028 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.975886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:09.976028 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:09.975977    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:09.979261 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.979237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rn786"]
Jul 30 17:01:09.979496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.979396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:09.979567 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:09.979508    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:09.979882 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.979860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4pq5s"]
Jul 30 17:01:09.979985 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:09.979971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:09.980111 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:09.980079    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:10.569175 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:10.569075    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03" containerID="4cde9b9c38f54e6fe54903454abd6eb11fdc3038c8586cffe33c70a6abe8e681" exitCode=0
Jul 30 17:01:10.569561 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:10.569178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerDied","Data":"4cde9b9c38f54e6fe54903454abd6eb11fdc3038c8586cffe33c70a6abe8e681"}
Jul 30 17:01:11.385012 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:11.384975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:11.385012 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:11.385005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:11.385240 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:11.385113    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:11.385280 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:11.385239    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:12.097445 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:12.097412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:12.385821 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:12.385744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:12.385958 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:12.385864    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:12.575960 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:12.575925    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03" containerID="9ecdcaaf117089b15fd35eb457085d8594b62cc25fee8acb02d84fb2c6034095" exitCode=0
Jul 30 17:01:12.576110 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:12.575967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerDied","Data":"9ecdcaaf117089b15fd35eb457085d8594b62cc25fee8acb02d84fb2c6034095"}
Jul 30 17:01:13.060139 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.060101    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.112467 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.112415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.316466 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.316370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.385141 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.385111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:13.385141 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.385121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:13.385378 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:13.385285    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:13.385434 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:13.385414    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:13.416447 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.416401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.510876 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.510844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.575031 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.574957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.742547 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.742507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.800048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.799998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.859072 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.858988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:13.961406 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.961376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:13.961593 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:13.961425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:13.961593 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:13.961537    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:01:13.961593 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:13.961543    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:01:13.961752 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:13.961603    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs podName:79e844a3-9703-4b0e-96e6-5b0309fe6e9f nodeName:}" failed. No retries permitted until 2026-07-30 17:01:45.961583824 +0000 UTC m=+66.114826510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs") pod "network-metrics-daemon-4pq5s" (UID: "79e844a3-9703-4b0e-96e6-5b0309fe6e9f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:01:13.961752 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:13.961625    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret podName:925f02ff-e731-48e7-ae5e-711d2ebfcf0c nodeName:}" failed. No retries permitted until 2026-07-30 17:01:45.961611955 +0000 UTC m=+66.114854635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret") pod "global-pull-secret-syncer-wk2gc" (UID: "925f02ff-e731-48e7-ae5e-711d2ebfcf0c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:01:14.062550 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:14.062512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:14.062711 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:14.062668    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:01:14.062711 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:14.062693    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:01:14.062711 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:14.062703    2560 projected.go:196] Error preparing data for projected volume kube-api-access-s7zwt for pod openshift-network-diagnostics/network-check-target-rn786: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:01:14.062835 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:14.062761    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt podName:1ebc3717-2c14-49d2-98ec-a5edeee7ea9d nodeName:}" failed. No retries permitted until 2026-07-30 17:01:46.062743462 +0000 UTC m=+66.215986165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s7zwt" (UniqueName: "kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt") pod "network-check-target-rn786" (UID: "1ebc3717-2c14-49d2-98ec-a5edeee7ea9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:01:14.385280 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:14.385244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:14.385728 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:14.385371    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rn786" podUID="1ebc3717-2c14-49d2-98ec-a5edeee7ea9d"
Jul 30 17:01:14.460169 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:14.460121    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqddk_8c22ffce-59f6-4289-b6e9-1f53daab03fa/dns-node-resolver/0.log"
Jul 30 17:01:14.946731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:14.946701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:15.046772 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.046737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:15.385971 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.385728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:15.386418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.385784    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:15.386418 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.386013    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wk2gc" podUID="925f02ff-e731-48e7-ae5e-711d2ebfcf0c"
Jul 30 17:01:15.386418 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.386090    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pq5s" podUID="79e844a3-9703-4b0e-96e6-5b0309fe6e9f"
Jul 30 17:01:15.642564 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.642481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:15.709471 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.709442    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-155.ec2.internal" event="NodeReady"
Jul 30 17:01:15.709650 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.709593    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 17:01:15.747525 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.747492    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5f77796-bb7tb"]
Jul 30 17:01:15.750350 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.750326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.752923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.752897    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 17:01:15.752923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.752913    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 17:01:15.753171 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.752979    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 17:01:15.753276 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.753258    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nffnt\""
Jul 30 17:01:15.761244 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.759581    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dgc8c"]
Jul 30 17:01:15.761671 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.761631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.762178 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.762002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 17:01:15.763964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.763945    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 17:01:15.764058 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.763991    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 17:01:15.764058 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.763996    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72fd8\""
Jul 30 17:01:15.766010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.765991    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kpp5v"]
Jul 30 17:01:15.768753 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.768732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5f77796-bb7tb"]
Jul 30 17:01:15.768859 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.768845    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.771165 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.771128    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tlpk\""
Jul 30 17:01:15.771257 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.771188    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 17:01:15.771450 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.771424    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 17:01:15.771549 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.771473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 17:01:15.771549 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.771473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 17:01:15.775037 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.775017    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dgc8c"]
Jul 30 17:01:15.781076 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.781052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpp5v"]
Jul 30 17:01:15.783872 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.783851    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pzgqx"]
Jul 30 17:01:15.785915 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.785898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:15.788062 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.788045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 17:01:15.788195 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.788052    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 17:01:15.788299 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.788282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 17:01:15.789206 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.789169    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hmptn\""
Jul 30 17:01:15.796398 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.796378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pzgqx"]
Jul 30 17:01:15.870246 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.870207    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fr8d6_5f8c5cb7-3ff4-419f-b3ed-446b21804bca/node-ca/0.log"
Jul 30 17:01:15.875554 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.875683 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.875683 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63ac5f58-00d4-43f0-94ae-287bdcc7deca-ca-trust-extracted\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.875683 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02da0d8b-019d-42d4-ad4c-a4274409a975-tmp-dir\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.875683 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-certificates\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.875862 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6c7m\" (UniqueName: \"kubernetes.io/projected/589ba723-47e3-445d-8bed-be7dbe18662e-kube-api-access-g6c7m\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.875862 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/589ba723-47e3-445d-8bed-be7dbe18662e-crio-socket\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.875862 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-trusted-ca\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.875862 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w92ct\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-kube-api-access-w92ct\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.876029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpk7m\" (UniqueName: \"kubernetes.io/projected/76c9a766-8248-43e9-841a-53cc29d8d3bc-kube-api-access-jpk7m\") pod \"ingress-canary-pzgqx\" (UID: \"76c9a766-8248-43e9-841a-53cc29d8d3bc\") " pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:15.876029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.876029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-installation-pull-secrets\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.876029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfm2\" (UniqueName: \"kubernetes.io/projected/02da0d8b-019d-42d4-ad4c-a4274409a975-kube-api-access-krfm2\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.876029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.875998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/589ba723-47e3-445d-8bed-be7dbe18662e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.876029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.876021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-image-registry-private-configuration\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.876288 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.876065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02da0d8b-019d-42d4-ad4c-a4274409a975-config-volume\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.876288 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.876089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/589ba723-47e3-445d-8bed-be7dbe18662e-data-volume\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.876288 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.876108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-bound-sa-token\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.876288 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.876134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76c9a766-8248-43e9-841a-53cc29d8d3bc-cert\") pod \"ingress-canary-pzgqx\" (UID: \"76c9a766-8248-43e9-841a-53cc29d8d3bc\") " pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:15.977008 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.976918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/589ba723-47e3-445d-8bed-be7dbe18662e-data-volume\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.977008 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.976968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-bound-sa-token\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977008 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.976998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76c9a766-8248-43e9-841a-53cc29d8d3bc-cert\") pod \"ingress-canary-pzgqx\" (UID: \"76c9a766-8248-43e9-841a-53cc29d8d3bc\") " pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.977193    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63ac5f58-00d4-43f0-94ae-287bdcc7deca-ca-trust-extracted\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.977230    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.977247    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5f77796-bb7tb: secret "image-registry-tls" not found
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.977253    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls podName:02da0d8b-019d-42d4-ad4c-a4274409a975 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:16.477232624 +0000 UTC m=+36.630475308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls") pod "dns-default-dgc8c" (UID: "02da0d8b-019d-42d4-ad4c-a4274409a975") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:15.977304 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.977300    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls podName:63ac5f58-00d4-43f0-94ae-287bdcc7deca nodeName:}" failed. No retries permitted until 2026-07-30 17:01:16.477280754 +0000 UTC m=+36.630523449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls") pod "image-registry-5d5f77796-bb7tb" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca") : secret "image-registry-tls" not found
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/589ba723-47e3-445d-8bed-be7dbe18662e-data-volume\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02da0d8b-019d-42d4-ad4c-a4274409a975-tmp-dir\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-certificates\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6c7m\" (UniqueName: \"kubernetes.io/projected/589ba723-47e3-445d-8bed-be7dbe18662e-kube-api-access-g6c7m\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/589ba723-47e3-445d-8bed-be7dbe18662e-crio-socket\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-trusted-ca\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w92ct\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-kube-api-access-w92ct\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977522    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpk7m\" (UniqueName: \"kubernetes.io/projected/76c9a766-8248-43e9-841a-53cc29d8d3bc-kube-api-access-jpk7m\") pod \"ingress-canary-pzgqx\" (UID: \"76c9a766-8248-43e9-841a-53cc29d8d3bc\") " pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-installation-pull-secrets\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02da0d8b-019d-42d4-ad4c-a4274409a975-tmp-dir\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krfm2\" (UniqueName: \"kubernetes.io/projected/02da0d8b-019d-42d4-ad4c-a4274409a975-kube-api-access-krfm2\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/589ba723-47e3-445d-8bed-be7dbe18662e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.977689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-image-registry-private-configuration\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02da0d8b-019d-42d4-ad4c-a4274409a975-config-volume\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/589ba723-47e3-445d-8bed-be7dbe18662e-crio-socket\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.977588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63ac5f58-00d4-43f0-94ae-287bdcc7deca-ca-trust-extracted\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.978000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-certificates\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.978172    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:15.978237    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls podName:589ba723-47e3-445d-8bed-be7dbe18662e nodeName:}" failed. No retries permitted until 2026-07-30 17:01:16.478219429 +0000 UTC m=+36.631462113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpp5v" (UID: "589ba723-47e3-445d-8bed-be7dbe18662e") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:15.978310 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.978299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02da0d8b-019d-42d4-ad4c-a4274409a975-config-volume\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.978598 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.978445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/589ba723-47e3-445d-8bed-be7dbe18662e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.978598 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.978553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-trusted-ca\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.982327 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.982294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-installation-pull-secrets\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.982327 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.982324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76c9a766-8248-43e9-841a-53cc29d8d3bc-cert\") pod \"ingress-canary-pzgqx\" (UID: \"76c9a766-8248-43e9-841a-53cc29d8d3bc\") " pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:15.982806 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.982781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-image-registry-private-configuration\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.987915 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.987891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfm2\" (UniqueName: \"kubernetes.io/projected/02da0d8b-019d-42d4-ad4c-a4274409a975-kube-api-access-krfm2\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:15.988496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.988477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-bound-sa-token\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.988734 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.988678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6c7m\" (UniqueName: \"kubernetes.io/projected/589ba723-47e3-445d-8bed-be7dbe18662e-kube-api-access-g6c7m\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:15.988852 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.988837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w92ct\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-kube-api-access-w92ct\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:15.990598 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:15.990578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpk7m\" (UniqueName: \"kubernetes.io/projected/76c9a766-8248-43e9-841a-53cc29d8d3bc-kube-api-access-jpk7m\") pod \"ingress-canary-pzgqx\" (UID: \"76c9a766-8248-43e9-841a-53cc29d8d3bc\") " pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:16.006234 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.006202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:16.096737 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.096695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pzgqx"
Jul 30 17:01:16.105655 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.105620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:16.339512 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.339420    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:16.385824 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.385782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:16.389035 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.389008    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 17:01:16.389511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.389019    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 17:01:16.389794 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.389772    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7mtp\""
Jul 30 17:01:16.481389 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.481352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:16.481588 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.481446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:16.481588 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.481478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:16.481588 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481515    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:16.481588 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481569    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:16.481588 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481578    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls podName:589ba723-47e3-445d-8bed-be7dbe18662e nodeName:}" failed. No retries permitted until 2026-07-30 17:01:17.481559012 +0000 UTC m=+37.634801697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpp5v" (UID: "589ba723-47e3-445d-8bed-be7dbe18662e") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:16.481799 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481601    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls podName:02da0d8b-019d-42d4-ad4c-a4274409a975 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:17.481591091 +0000 UTC m=+37.634833773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls") pod "dns-default-dgc8c" (UID: "02da0d8b-019d-42d4-ad4c-a4274409a975") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:16.481799 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481619    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:16.481799 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481640    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5f77796-bb7tb: secret "image-registry-tls" not found
Jul 30 17:01:16.481799 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:16.481712    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls podName:63ac5f58-00d4-43f0-94ae-287bdcc7deca nodeName:}" failed. No retries permitted until 2026-07-30 17:01:17.481692489 +0000 UTC m=+37.634935188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls") pod "image-registry-5d5f77796-bb7tb" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca") : secret "image-registry-tls" not found
Jul 30 17:01:16.511445 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.511401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:16.597309 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.597216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:16.744451 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:16.744416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pzgqx"]
Jul 30 17:01:16.748166 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:16.748122    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c9a766_8248_43e9_841a_53cc29d8d3bc.slice/crio-77dfb3b9ae235cb814415cceba0882aeffa5e37cd900043b9bc996ac84c55a9a WatchSource:0}: Error finding container 77dfb3b9ae235cb814415cceba0882aeffa5e37cd900043b9bc996ac84c55a9a: Status 404 returned error can't find the container with id 77dfb3b9ae235cb814415cceba0882aeffa5e37cd900043b9bc996ac84c55a9a
Jul 30 17:01:17.385923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.385738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:17.386073 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.385791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:17.389513 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.389490    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 17:01:17.390214 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.389738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 17:01:17.390214 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.389848    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqjnm\""
Jul 30 17:01:17.489011 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.488974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:17.489229 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489174    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:17.489229 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.489205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:17.489337 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489236    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls podName:589ba723-47e3-445d-8bed-be7dbe18662e nodeName:}" failed. No retries permitted until 2026-07-30 17:01:19.489221317 +0000 UTC m=+39.642463998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpp5v" (UID: "589ba723-47e3-445d-8bed-be7dbe18662e") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:17.489337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.489267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:17.489337 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489275    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:17.489337 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489286    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5f77796-bb7tb: secret "image-registry-tls" not found
Jul 30 17:01:17.489337 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489325    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls podName:63ac5f58-00d4-43f0-94ae-287bdcc7deca nodeName:}" failed. No retries permitted until 2026-07-30 17:01:19.489313285 +0000 UTC m=+39.642555967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls") pod "image-registry-5d5f77796-bb7tb" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca") : secret "image-registry-tls" not found
Jul 30 17:01:17.489528 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489349    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:17.489528 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:17.489374    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls podName:02da0d8b-019d-42d4-ad4c-a4274409a975 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:19.489367484 +0000 UTC m=+39.642610166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls") pod "dns-default-dgc8c" (UID: "02da0d8b-019d-42d4-ad4c-a4274409a975") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:17.591999 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.591965    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03" containerID="7b9cb86d2a7e98a0b2d72b91dd0d4d969910bf1c9a9f8a83c8dcc3e2281efaa0" exitCode=0
Jul 30 17:01:17.591999 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.591991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerDied","Data":"7b9cb86d2a7e98a0b2d72b91dd0d4d969910bf1c9a9f8a83c8dcc3e2281efaa0"}
Jul 30 17:01:17.593503 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:17.593471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pzgqx" event={"ID":"76c9a766-8248-43e9-841a-53cc29d8d3bc","Type":"ContainerStarted","Data":"77dfb3b9ae235cb814415cceba0882aeffa5e37cd900043b9bc996ac84c55a9a"}
Jul 30 17:01:18.599876 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:18.599837    2560 generic.go:356] "Generic (PLEG): container finished" podID="cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03" containerID="23f0747f6dddf0bd1cab1a54020f10bafbbd4e6fef54f08c99de661a91db9326" exitCode=0
Jul 30 17:01:18.600378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:18.599895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerDied","Data":"23f0747f6dddf0bd1cab1a54020f10bafbbd4e6fef54f08c99de661a91db9326"}
Jul 30 17:01:19.504615 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:19.504525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:19.504615 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:19.504591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:19.504615 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:19.504613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504693    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504709    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504722    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504741    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5f77796-bb7tb: secret "image-registry-tls" not found
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls podName:02da0d8b-019d-42d4-ad4c-a4274409a975 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:23.50474632 +0000 UTC m=+43.657989001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls") pod "dns-default-dgc8c" (UID: "02da0d8b-019d-42d4-ad4c-a4274409a975") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504778    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls podName:63ac5f58-00d4-43f0-94ae-287bdcc7deca nodeName:}" failed. No retries permitted until 2026-07-30 17:01:23.504765408 +0000 UTC m=+43.658008088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls") pod "image-registry-5d5f77796-bb7tb" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca") : secret "image-registry-tls" not found
Jul 30 17:01:19.504849 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:01:19.504792    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls podName:589ba723-47e3-445d-8bed-be7dbe18662e nodeName:}" failed. No retries permitted until 2026-07-30 17:01:23.504785655 +0000 UTC m=+43.658028336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpp5v" (UID: "589ba723-47e3-445d-8bed-be7dbe18662e") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:19.630024 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:19.629991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72cvr" event={"ID":"cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03","Type":"ContainerStarted","Data":"56d17a487573c1e91be210427efb48367efc6ff9f292e76125898d513b7b2c46"}
Jul 30 17:01:19.653285 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:19.653239    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-72cvr" podStartSLOduration=8.156977094 podStartE2EDuration="39.653224109s" totalImagesPullingTime="31.496247015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:19.652769722 +0000 UTC m=+39.806012426" watchObservedRunningTime="2026-07-30 17:01:19.653224109 +0000 UTC m=+39.806466828"
Jul 30 17:01:20.633991 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:20.633949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pzgqx" event={"ID":"76c9a766-8248-43e9-841a-53cc29d8d3bc","Type":"ContainerStarted","Data":"8577b90a38375f641d1f994884613661f6e1cb55ceaec49c02d17508139ebc14"}
Jul 30 17:01:20.648047 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:20.647991    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pzgqx" podStartSLOduration=2.831813391 podStartE2EDuration="5.647974058s" totalImagesPullingTime="2.816160667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:20.647610626 +0000 UTC m=+40.800853330" watchObservedRunningTime="2026-07-30 17:01:20.647974058 +0000 UTC m=+40.801216761"
Jul 30 17:01:23.539029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.538988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:23.539029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.539032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:23.539510 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.539222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:23.543031 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.543004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02da0d8b-019d-42d4-ad4c-a4274409a975-metrics-tls\") pod \"dns-default-dgc8c\" (UID: \"02da0d8b-019d-42d4-ad4c-a4274409a975\") " pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:23.543144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.543004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589ba723-47e3-445d-8bed-be7dbe18662e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpp5v\" (UID: \"589ba723-47e3-445d-8bed-be7dbe18662e\") " pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:23.560749 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.560724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"image-registry-5d5f77796-bb7tb\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") " pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:23.562532 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.562513    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:23.573682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.573662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:23.581800 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.581778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpp5v"
Jul 30 17:01:23.736278 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.736246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5f77796-bb7tb"]
Jul 30 17:01:23.738746 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:23.738710    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ac5f58_00d4_43f0_94ae_287bdcc7deca.slice/crio-0ea7be69ba09c929264c384518b613e864f66c17d0903def6c543d2a56aaaf4b WatchSource:0}: Error finding container 0ea7be69ba09c929264c384518b613e864f66c17d0903def6c543d2a56aaaf4b: Status 404 returned error can't find the container with id 0ea7be69ba09c929264c384518b613e864f66c17d0903def6c543d2a56aaaf4b
Jul 30 17:01:23.751227 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.751193    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dgc8c"]
Jul 30 17:01:23.754448 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:23.754422    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02da0d8b_019d_42d4_ad4c_a4274409a975.slice/crio-941f68b468de61ebae8d47218431199b65573c33116de0a076e6e8724586a05d WatchSource:0}: Error finding container 941f68b468de61ebae8d47218431199b65573c33116de0a076e6e8724586a05d: Status 404 returned error can't find the container with id 941f68b468de61ebae8d47218431199b65573c33116de0a076e6e8724586a05d
Jul 30 17:01:23.777093 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:23.777066    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpp5v"]
Jul 30 17:01:23.792134 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:23.792109    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589ba723_47e3_445d_8bed_be7dbe18662e.slice/crio-5f857c383a022f8eef6ea2a622f2404d9725d044ed8bf21293ff2100c9bc4017 WatchSource:0}: Error finding container 5f857c383a022f8eef6ea2a622f2404d9725d044ed8bf21293ff2100c9bc4017: Status 404 returned error can't find the container with id 5f857c383a022f8eef6ea2a622f2404d9725d044ed8bf21293ff2100c9bc4017
Jul 30 17:01:24.647269 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:24.647195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgc8c" event={"ID":"02da0d8b-019d-42d4-ad4c-a4274409a975","Type":"ContainerStarted","Data":"941f68b468de61ebae8d47218431199b65573c33116de0a076e6e8724586a05d"}
Jul 30 17:01:24.649933 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:24.649477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb" event={"ID":"63ac5f58-00d4-43f0-94ae-287bdcc7deca","Type":"ContainerStarted","Data":"809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91"}
Jul 30 17:01:24.649933 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:24.649531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb" event={"ID":"63ac5f58-00d4-43f0-94ae-287bdcc7deca","Type":"ContainerStarted","Data":"0ea7be69ba09c929264c384518b613e864f66c17d0903def6c543d2a56aaaf4b"}
Jul 30 17:01:24.649933 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:24.649738    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:24.651171 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:24.651126    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpp5v" event={"ID":"589ba723-47e3-445d-8bed-be7dbe18662e","Type":"ContainerStarted","Data":"5f857c383a022f8eef6ea2a622f2404d9725d044ed8bf21293ff2100c9bc4017"}
Jul 30 17:01:24.668043 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:24.667978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb" podStartSLOduration=20.667959251 podStartE2EDuration="20.667959251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:24.666948727 +0000 UTC m=+44.820191449" watchObservedRunningTime="2026-07-30 17:01:24.667959251 +0000 UTC m=+44.821201956"
Jul 30 17:01:30.671349 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:30.671312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgc8c" event={"ID":"02da0d8b-019d-42d4-ad4c-a4274409a975","Type":"ContainerStarted","Data":"b6c4ce281c8bbed4230f069afd2af1606eb95002234815ff4347c26139019283"}
Jul 30 17:01:30.671803 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:30.671375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:30.671803 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:30.671399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dgc8c" event={"ID":"02da0d8b-019d-42d4-ad4c-a4274409a975","Type":"ContainerStarted","Data":"c23ed40b207bed7bfa029bed68e980b37e2604a5630b4d82cf8a017a59ed962e"}
Jul 30 17:01:30.672729 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:30.672705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpp5v" event={"ID":"589ba723-47e3-445d-8bed-be7dbe18662e","Type":"ContainerStarted","Data":"d8f39147bc4ff625f1dc190b83ed5ef61ab66565506939ca9abd9c723bbcf26d"}
Jul 30 17:01:30.690142 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:30.688692    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dgc8c" podStartSLOduration=9.647681768 podStartE2EDuration="15.688676027s" totalImagesPullingTime="6.040994259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:30.687226548 +0000 UTC m=+50.840469252" watchObservedRunningTime="2026-07-30 17:01:30.688676027 +0000 UTC m=+50.841918726"
Jul 30 17:01:35.688381 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.688348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpp5v" event={"ID":"589ba723-47e3-445d-8bed-be7dbe18662e","Type":"ContainerStarted","Data":"15c8e850da646cc133808dd57e9379f14b590a3d1ede7b217d28caa94209155a"}
Jul 30 17:01:35.804211 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.804170    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"]
Jul 30 17:01:35.805917 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.805896    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.810404 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.810224    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-npvp4\""
Jul 30 17:01:35.810404 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.810224    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 17:01:35.810404 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.810298    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 17:01:35.824667 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.824637    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d5f77796-bb7tb"]
Jul 30 17:01:35.826171 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.825994    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"]
Jul 30 17:01:35.828186 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.828125    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"]
Jul 30 17:01:35.828845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.828409    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.833265 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.831512    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.842769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.842200    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 17:01:35.842769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.842255    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 17:01:35.842769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.842202    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 30 17:01:35.842769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.842200    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 30 17:01:35.842769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.842595    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 17:01:35.843073 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.843073 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-tmp\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.843242 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plgh\" (UniqueName: \"kubernetes.io/projected/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-kube-api-access-2plgh\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.843242 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b57fd48d8-5klrh\" (UID: \"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.843242 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hft7\" (UniqueName: \"kubernetes.io/projected/4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5-kube-api-access-6hft7\") pod \"managed-serviceaccount-addon-agent-5b57fd48d8-5klrh\" (UID: \"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.843397 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c4026e4-d57a-45a3-a000-2eb94b3887a0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7kpvs\" (UID: \"3c4026e4-d57a-45a3-a000-2eb94b3887a0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.843397 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c4026e4-d57a-45a3-a000-2eb94b3887a0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7kpvs\" (UID: \"3c4026e4-d57a-45a3-a000-2eb94b3887a0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.845190 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843590    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-shjms\""
Jul 30 17:01:35.845190 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.843834    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"]
Jul 30 17:01:35.848929 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.848906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"]
Jul 30 17:01:35.849093 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.849017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.852992 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.852758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"]
Jul 30 17:01:35.855444 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.855424    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 30 17:01:35.855533 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.855476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 30 17:01:35.856239 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.856221    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 30 17:01:35.856608 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.856441    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 30 17:01:35.871285 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.871261    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"]
Jul 30 17:01:35.886111 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.886079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"]
Jul 30 17:01:35.921382 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.921349    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d4995675-zfsfh"]
Jul 30 17:01:35.923973 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.923646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.942748 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.942675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4995675-zfsfh"]
Jul 30 17:01:35.943918 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.943807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b633b3-8bbc-480d-b328-111eb359b2d1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.943918 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.943846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/691e8d11-d2a5-452e-8820-40cf2e33489f-ca-trust-extracted\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.943918 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.943884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-tmp\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.944183 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.943953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/691e8d11-d2a5-452e-8820-40cf2e33489f-registry-certificates\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.944183 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-bound-sa-token\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.944183 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c6vj\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-kube-api-access-7c6vj\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.944348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-registry-tls\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.944348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-ca\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.944427 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-tmp\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.944427 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.944427 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/691e8d11-d2a5-452e-8820-40cf2e33489f-installation-pull-secrets\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.944530 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c4026e4-d57a-45a3-a000-2eb94b3887a0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7kpvs\" (UID: \"3c4026e4-d57a-45a3-a000-2eb94b3887a0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.944530 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.944530 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-hub\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.944530 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7s42\" (UniqueName: \"kubernetes.io/projected/54b633b3-8bbc-480d-b328-111eb359b2d1-kube-api-access-h7s42\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.944666 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2plgh\" (UniqueName: \"kubernetes.io/projected/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-kube-api-access-2plgh\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.944666 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b57fd48d8-5klrh\" (UID: \"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.944666 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hft7\" (UniqueName: \"kubernetes.io/projected/4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5-kube-api-access-6hft7\") pod \"managed-serviceaccount-addon-agent-5b57fd48d8-5klrh\" (UID: \"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.944765 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/691e8d11-d2a5-452e-8820-40cf2e33489f-image-registry-private-configuration\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.944765 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:35.944765 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c4026e4-d57a-45a3-a000-2eb94b3887a0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7kpvs\" (UID: \"3c4026e4-d57a-45a3-a000-2eb94b3887a0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.944765 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.944754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/691e8d11-d2a5-452e-8820-40cf2e33489f-trusted-ca\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:35.945867 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.945825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3c4026e4-d57a-45a3-a000-2eb94b3887a0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7kpvs\" (UID: \"3c4026e4-d57a-45a3-a000-2eb94b3887a0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.948659 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.948611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b57fd48d8-5klrh\" (UID: \"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.949316 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.949292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c4026e4-d57a-45a3-a000-2eb94b3887a0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7kpvs\" (UID: \"3c4026e4-d57a-45a3-a000-2eb94b3887a0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:35.949779 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.949763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:35.963403 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.963372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hft7\" (UniqueName: \"kubernetes.io/projected/4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5-kube-api-access-6hft7\") pod \"managed-serviceaccount-addon-agent-5b57fd48d8-5klrh\" (UID: \"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:35.971165 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:35.971120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plgh\" (UniqueName: \"kubernetes.io/projected/39abcaa3-3d1d-4e54-9624-f521d5cf0bb1-kube-api-access-2plgh\") pod \"klusterlet-addon-workmgr-7f776cd567-6nb2r\" (UID: \"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:36.045894 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.045853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-hub\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.045894 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.045900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7s42\" (UniqueName: \"kubernetes.io/projected/54b633b3-8bbc-480d-b328-111eb359b2d1-kube-api-access-h7s42\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.045944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/691e8d11-d2a5-452e-8820-40cf2e33489f-image-registry-private-configuration\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.045975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/691e8d11-d2a5-452e-8820-40cf2e33489f-trusted-ca\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b633b3-8bbc-480d-b328-111eb359b2d1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/691e8d11-d2a5-452e-8820-40cf2e33489f-ca-trust-extracted\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/691e8d11-d2a5-452e-8820-40cf2e33489f-registry-certificates\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-bound-sa-token\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c6vj\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-kube-api-access-7c6vj\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-registry-tls\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.046563 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-ca\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.046563 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.046563 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/691e8d11-d2a5-452e-8820-40cf2e33489f-installation-pull-secrets\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.047611 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.046988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/691e8d11-d2a5-452e-8820-40cf2e33489f-registry-certificates\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.047611 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.047285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/691e8d11-d2a5-452e-8820-40cf2e33489f-trusted-ca\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.047611 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.047307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/691e8d11-d2a5-452e-8820-40cf2e33489f-ca-trust-extracted\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.047611 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.047576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b633b3-8bbc-480d-b328-111eb359b2d1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.049469 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.049444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/691e8d11-d2a5-452e-8820-40cf2e33489f-installation-pull-secrets\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.050221 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.050194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-registry-tls\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.050328 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.050297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.050423 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.050395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-ca\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.050570 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.050546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/691e8d11-d2a5-452e-8820-40cf2e33489f-image-registry-private-configuration\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.050904 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.050885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.051077 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.051061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/54b633b3-8bbc-480d-b328-111eb359b2d1-hub\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.058737 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.058707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7s42\" (UniqueName: \"kubernetes.io/projected/54b633b3-8bbc-480d-b328-111eb359b2d1-kube-api-access-h7s42\") pod \"cluster-proxy-proxy-agent-689d66c789-kf8nb\" (UID: \"54b633b3-8bbc-480d-b328-111eb359b2d1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.058899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.058881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c6vj\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-kube-api-access-7c6vj\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.059603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.059573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/691e8d11-d2a5-452e-8820-40cf2e33489f-bound-sa-token\") pod \"image-registry-d4995675-zfsfh\" (UID: \"691e8d11-d2a5-452e-8820-40cf2e33489f\") " pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.117056 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.117025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"
Jul 30 17:01:36.148119 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.148089    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:36.164996 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.164940    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"
Jul 30 17:01:36.171251 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.171217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"
Jul 30 17:01:36.262101 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.261683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.291709 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.291619    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs"]
Jul 30 17:01:36.301176 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:36.300669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4026e4_d57a_45a3_a000_2eb94b3887a0.slice/crio-4b5f471f1dd71a872569906ed0bd0f3ef7040b6bd934d0d50b5a88f669d96003 WatchSource:0}: Error finding container 4b5f471f1dd71a872569906ed0bd0f3ef7040b6bd934d0d50b5a88f669d96003: Status 404 returned error can't find the container with id 4b5f471f1dd71a872569906ed0bd0f3ef7040b6bd934d0d50b5a88f669d96003
Jul 30 17:01:36.336925 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.336847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"]
Jul 30 17:01:36.347066 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:36.347020    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39abcaa3_3d1d_4e54_9624_f521d5cf0bb1.slice/crio-991d86abe38f03d92554d4f8e37446a35d059db231d80ef8d5d7cd61acb3df78 WatchSource:0}: Error finding container 991d86abe38f03d92554d4f8e37446a35d059db231d80ef8d5d7cd61acb3df78: Status 404 returned error can't find the container with id 991d86abe38f03d92554d4f8e37446a35d059db231d80ef8d5d7cd61acb3df78
Jul 30 17:01:36.377981 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.377952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb"]
Jul 30 17:01:36.382463 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:36.382436    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54b633b3_8bbc_480d_b328_111eb359b2d1.slice/crio-b1bb4e0ea480ab3b23acd6e22db827b3b04f19a1de1c7b1cdc6e29b6717e60ab WatchSource:0}: Error finding container b1bb4e0ea480ab3b23acd6e22db827b3b04f19a1de1c7b1cdc6e29b6717e60ab: Status 404 returned error can't find the container with id b1bb4e0ea480ab3b23acd6e22db827b3b04f19a1de1c7b1cdc6e29b6717e60ab
Jul 30 17:01:36.389132 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:36.389102    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d0d3a32_1c59_4ba6_b1ea_b6ae6b4eb2c5.slice/crio-257df6176ab249bb52680374d8fe8c3d4881e009d8946be56612c399751aae2c WatchSource:0}: Error finding container 257df6176ab249bb52680374d8fe8c3d4881e009d8946be56612c399751aae2c: Status 404 returned error can't find the container with id 257df6176ab249bb52680374d8fe8c3d4881e009d8946be56612c399751aae2c
Jul 30 17:01:36.393453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.393234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh"]
Jul 30 17:01:36.448508 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.448471    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4995675-zfsfh"]
Jul 30 17:01:36.452578 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:36.452544    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691e8d11_d2a5_452e_8820_40cf2e33489f.slice/crio-14a08a8135ebfead5a43fa7a35856a44fc664225f265e96569029e4489b12526 WatchSource:0}: Error finding container 14a08a8135ebfead5a43fa7a35856a44fc664225f265e96569029e4489b12526: Status 404 returned error can't find the container with id 14a08a8135ebfead5a43fa7a35856a44fc664225f265e96569029e4489b12526
Jul 30 17:01:36.693771 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.693729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4995675-zfsfh" event={"ID":"691e8d11-d2a5-452e-8820-40cf2e33489f","Type":"ContainerStarted","Data":"09f0a80b60daf5e920ad69a59ffd19badf7bb34cfc84b852d197c84832996de8"}
Jul 30 17:01:36.694257 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.693796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4995675-zfsfh" event={"ID":"691e8d11-d2a5-452e-8820-40cf2e33489f","Type":"ContainerStarted","Data":"14a08a8135ebfead5a43fa7a35856a44fc664225f265e96569029e4489b12526"}
Jul 30 17:01:36.694257 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.693827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:36.694987 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.694960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh" event={"ID":"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5","Type":"ContainerStarted","Data":"257df6176ab249bb52680374d8fe8c3d4881e009d8946be56612c399751aae2c"}
Jul 30 17:01:36.696320 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.696295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb" event={"ID":"54b633b3-8bbc-480d-b328-111eb359b2d1","Type":"ContainerStarted","Data":"b1bb4e0ea480ab3b23acd6e22db827b3b04f19a1de1c7b1cdc6e29b6717e60ab"}
Jul 30 17:01:36.697515 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.697484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r" event={"ID":"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1","Type":"ContainerStarted","Data":"991d86abe38f03d92554d4f8e37446a35d059db231d80ef8d5d7cd61acb3df78"}
Jul 30 17:01:36.699241 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.699219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs" event={"ID":"3c4026e4-d57a-45a3-a000-2eb94b3887a0","Type":"ContainerStarted","Data":"4b5f471f1dd71a872569906ed0bd0f3ef7040b6bd934d0d50b5a88f669d96003"}
Jul 30 17:01:36.713237 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:36.713184    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d4995675-zfsfh" podStartSLOduration=1.7131690389999998 podStartE2EDuration="1.713169039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:36.711800549 +0000 UTC m=+56.865043253" watchObservedRunningTime="2026-07-30 17:01:36.713169039 +0000 UTC m=+56.866411736"
Jul 30 17:01:40.677278 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:40.677250    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dgc8c"
Jul 30 17:01:41.588714 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:41.588684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4rcq"
Jul 30 17:01:44.733875 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.733826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpp5v" event={"ID":"589ba723-47e3-445d-8bed-be7dbe18662e","Type":"ContainerStarted","Data":"f0f1f3142240dbf55b933dd014dd6c2717d598b0971bcfd0603d9bfb089620fd"}
Jul 30 17:01:44.735454 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.735427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh" event={"ID":"4d0d3a32-1c59-4ba6-b1ea-b6ae6b4eb2c5","Type":"ContainerStarted","Data":"3727e0ea1c72878dd30ea35e139e91245b599fe6476243ee86934e1c5dd5767d"}
Jul 30 17:01:44.737373 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.737350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb" event={"ID":"54b633b3-8bbc-480d-b328-111eb359b2d1","Type":"ContainerStarted","Data":"86b67a74f67d4c88d8e82d9352e7483879f74b488449377ccdf268e631da2c77"}
Jul 30 17:01:44.737491 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.737388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb" event={"ID":"54b633b3-8bbc-480d-b328-111eb359b2d1","Type":"ContainerStarted","Data":"967033e19c73253392d28192ee3636f1f752c6e1afe314e467c42b4e69bd4ed8"}
Jul 30 17:01:44.737491 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.737405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb" event={"ID":"54b633b3-8bbc-480d-b328-111eb359b2d1","Type":"ContainerStarted","Data":"9f9ca368a9efd83bc7bae3c96fd30e939dc351989a4fdd8387864bcedd6686a9"}
Jul 30 17:01:44.738755 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.738736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r" event={"ID":"39abcaa3-3d1d-4e54-9624-f521d5cf0bb1","Type":"ContainerStarted","Data":"8a3084cdfc0f461f155d6c1bde67f21e0d68bedd403cea474f9525bab974b36a"}
Jul 30 17:01:44.738873 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.738860    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:44.740431 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.740406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs" event={"ID":"3c4026e4-d57a-45a3-a000-2eb94b3887a0","Type":"ContainerStarted","Data":"ca67b2ed0e27b145b29a02c28b11ece220762a8d557318724b01b5c5651c95ef"}
Jul 30 17:01:44.740840 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.740822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r"
Jul 30 17:01:44.749772 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.749728    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kpp5v" podStartSLOduration=9.58269398 podStartE2EDuration="29.749712404s" totalImagesPullingTime="20.167018424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:01:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:44.749399476 +0000 UTC m=+64.902642181" watchObservedRunningTime="2026-07-30 17:01:44.749712404 +0000 UTC m=+64.902955122"
Jul 30 17:01:44.763415 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.763365    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b57fd48d8-5klrh" podStartSLOduration=1.9271144100000002 podStartE2EDuration="9.763349334s" totalImagesPullingTime="7.836234924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:44.762712149 +0000 UTC m=+64.915954852" watchObservedRunningTime="2026-07-30 17:01:44.763349334 +0000 UTC m=+64.916592015"
Jul 30 17:01:44.780935 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.780877    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689d66c789-kf8nb" podStartSLOduration=1.954773253 podStartE2EDuration="9.780857382s" totalImagesPullingTime="7.826084129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:44.779085419 +0000 UTC m=+64.932328122" watchObservedRunningTime="2026-07-30 17:01:44.780857382 +0000 UTC m=+64.934100084"
Jul 30 17:01:44.793594 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.793538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7kpvs" podStartSLOduration=1.91781435 podStartE2EDuration="9.793520558s" totalImagesPullingTime="7.875706208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:44.792184471 +0000 UTC m=+64.945427177" watchObservedRunningTime="2026-07-30 17:01:44.793520558 +0000 UTC m=+64.946763260"
Jul 30 17:01:44.805816 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:44.805769    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f776cd567-6nb2r" podStartSLOduration=1.91916208 podStartE2EDuration="9.805756564s" totalImagesPullingTime="7.886594484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:44.805612071 +0000 UTC m=+64.958854776" watchObservedRunningTime="2026-07-30 17:01:44.805756564 +0000 UTC m=+64.958999266"
Jul 30 17:01:45.830265 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:45.830238    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:01:46.037328 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.037280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:46.037328 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.037336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:46.039609 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.039591    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 17:01:46.039676 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.039625    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 17:01:46.050178 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.050115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925f02ff-e731-48e7-ae5e-711d2ebfcf0c-original-pull-secret\") pod \"global-pull-secret-syncer-wk2gc\" (UID: \"925f02ff-e731-48e7-ae5e-711d2ebfcf0c\") " pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:46.050309 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.050183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79e844a3-9703-4b0e-96e6-5b0309fe6e9f-metrics-certs\") pod \"network-metrics-daemon-4pq5s\" (UID: \"79e844a3-9703-4b0e-96e6-5b0309fe6e9f\") " pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:46.138694 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.138596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:46.141354 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.141330    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 17:01:46.151057 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.151037    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 17:01:46.162145 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.162123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zwt\" (UniqueName: \"kubernetes.io/projected/1ebc3717-2c14-49d2-98ec-a5edeee7ea9d-kube-api-access-s7zwt\") pod \"network-check-target-rn786\" (UID: \"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d\") " pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:46.200755 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.200727    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqjnm\""
Jul 30 17:01:46.204513 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.204496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wk2gc"
Jul 30 17:01:46.208401 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.208382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pq5s"
Jul 30 17:01:46.353829 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.353790    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wk2gc"]
Jul 30 17:01:46.356893 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:46.356866    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925f02ff_e731_48e7_ae5e_711d2ebfcf0c.slice/crio-63fde0d65d34f10ee5b050dac95993035084c16d0f0d2ebb1cf12a04760b385c WatchSource:0}: Error finding container 63fde0d65d34f10ee5b050dac95993035084c16d0f0d2ebb1cf12a04760b385c: Status 404 returned error can't find the container with id 63fde0d65d34f10ee5b050dac95993035084c16d0f0d2ebb1cf12a04760b385c
Jul 30 17:01:46.375550 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.375522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4pq5s"]
Jul 30 17:01:46.378821 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:46.378792    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e844a3_9703_4b0e_96e6_5b0309fe6e9f.slice/crio-1c123a853cc307557a2833a6251df7a5352fbe57a488093e12b4506493e313ef WatchSource:0}: Error finding container 1c123a853cc307557a2833a6251df7a5352fbe57a488093e12b4506493e313ef: Status 404 returned error can't find the container with id 1c123a853cc307557a2833a6251df7a5352fbe57a488093e12b4506493e313ef
Jul 30 17:01:46.400115 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.400041    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7mtp\""
Jul 30 17:01:46.407903 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.407879    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:46.537441 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.537405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rn786"]
Jul 30 17:01:46.540419 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:46.540393    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebc3717_2c14_49d2_98ec_a5edeee7ea9d.slice/crio-1d6bfb7b95190f5b535116d07bf7f7f2ae37a9837172d0ac47ebe8f5192fd98b WatchSource:0}: Error finding container 1d6bfb7b95190f5b535116d07bf7f7f2ae37a9837172d0ac47ebe8f5192fd98b: Status 404 returned error can't find the container with id 1d6bfb7b95190f5b535116d07bf7f7f2ae37a9837172d0ac47ebe8f5192fd98b
Jul 30 17:01:46.748473 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.748441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rn786" event={"ID":"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d","Type":"ContainerStarted","Data":"1d6bfb7b95190f5b535116d07bf7f7f2ae37a9837172d0ac47ebe8f5192fd98b"}
Jul 30 17:01:46.749528 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.749502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4pq5s" event={"ID":"79e844a3-9703-4b0e-96e6-5b0309fe6e9f","Type":"ContainerStarted","Data":"1c123a853cc307557a2833a6251df7a5352fbe57a488093e12b4506493e313ef"}
Jul 30 17:01:46.750554 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:46.750529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wk2gc" event={"ID":"925f02ff-e731-48e7-ae5e-711d2ebfcf0c","Type":"ContainerStarted","Data":"63fde0d65d34f10ee5b050dac95993035084c16d0f0d2ebb1cf12a04760b385c"}
Jul 30 17:01:48.762847 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:48.762761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4pq5s" event={"ID":"79e844a3-9703-4b0e-96e6-5b0309fe6e9f","Type":"ContainerStarted","Data":"e38b71b613cafead2f48881d99bea71ef3f3e215cbc91a42e063d7e0c74641f5"}
Jul 30 17:01:48.762847 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:48.762825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4pq5s" event={"ID":"79e844a3-9703-4b0e-96e6-5b0309fe6e9f","Type":"ContainerStarted","Data":"28430ed692ef58249e7fc1adee04f7c90e2160172ec33ba0be9a19d1de29f3ce"}
Jul 30 17:01:48.779901 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:48.779616    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4pq5s" podStartSLOduration=67.007154872 podStartE2EDuration="1m8.779593274s" totalImagesPullingTime="1.772438402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:48.77876094 +0000 UTC m=+68.932003644" watchObservedRunningTime="2026-07-30 17:01:48.779593274 +0000 UTC m=+68.932835978"
Jul 30 17:01:52.779012 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:52.778978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wk2gc" event={"ID":"925f02ff-e731-48e7-ae5e-711d2ebfcf0c","Type":"ContainerStarted","Data":"4539f3bc446db5c000b440660fed50a7a41fbc499d3f4cd08ce8cf4826c70a85"}
Jul 30 17:01:52.780378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:52.780352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rn786" event={"ID":"1ebc3717-2c14-49d2-98ec-a5edeee7ea9d","Type":"ContainerStarted","Data":"dde0294ecd3da06707ee6a4de8c04e551ec2952623f8f9dc84164090ba1c3f82"}
Jul 30 17:01:52.780509 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:52.780491    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:01:52.794420 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:52.794374    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wk2gc" podStartSLOduration=67.404009545 podStartE2EDuration="1m12.794361169s" totalImagesPullingTime="5.390351624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:52.793841241 +0000 UTC m=+72.947083947" watchObservedRunningTime="2026-07-30 17:01:52.794361169 +0000 UTC m=+72.947603871"
Jul 30 17:01:52.808039 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:52.807994    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rn786" podStartSLOduration=67.604040884 podStartE2EDuration="1m12.807979476s" totalImagesPullingTime="5.203938592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:52.80791912 +0000 UTC m=+72.961161841" watchObservedRunningTime="2026-07-30 17:01:52.807979476 +0000 UTC m=+72.961222178"
Jul 30 17:01:56.512627 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.512584    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4m7z8"]
Jul 30 17:01:56.514775 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.514753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.517008 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.516987    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m27tn\""
Jul 30 17:01:56.517137 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.517010    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 17:01:56.517200 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.517163    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 17:01:56.517692 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.517663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 17:01:56.517779 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.517689    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 17:01:56.517779 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.517696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 17:01:56.517779 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.517709    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 17:01:56.622134 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwk24\" (UniqueName: \"kubernetes.io/projected/3726abb7-66b3-4f85-bec8-f482c2cc5f27-kube-api-access-lwk24\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622355 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-wtmp\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622355 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622355 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-root\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622355 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622519 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3726abb7-66b3-4f85-bec8-f482c2cc5f27-metrics-client-ca\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622519 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-textfile\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622519 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-tls\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.622519 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.622469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-sys\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-sys\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwk24\" (UniqueName: \"kubernetes.io/projected/3726abb7-66b3-4f85-bec8-f482c2cc5f27-kube-api-access-lwk24\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-wtmp\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-root\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-sys\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3726abb7-66b3-4f85-bec8-f482c2cc5f27-metrics-client-ca\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-wtmp\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-textfile\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.723757 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3726abb7-66b3-4f85-bec8-f482c2cc5f27-root\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.724206 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.723754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-tls\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.724206 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.724112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-textfile\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.724308 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.724291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.724350 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.724318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3726abb7-66b3-4f85-bec8-f482c2cc5f27-metrics-client-ca\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.726121 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.726096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-tls\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.726252 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.726201    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3726abb7-66b3-4f85-bec8-f482c2cc5f27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.731291 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.731271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwk24\" (UniqueName: \"kubernetes.io/projected/3726abb7-66b3-4f85-bec8-f482c2cc5f27-kube-api-access-lwk24\") pod \"node-exporter-4m7z8\" (UID: \"3726abb7-66b3-4f85-bec8-f482c2cc5f27\") " pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.824641 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:56.824548    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m7z8"
Jul 30 17:01:56.844485 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:01:56.844458    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3726abb7_66b3_4f85_bec8_f482c2cc5f27.slice/crio-cb566fa10e379b2efd9e52194fe8fceda23ff17f8538b20778e265a8f2eba62d WatchSource:0}: Error finding container cb566fa10e379b2efd9e52194fe8fceda23ff17f8538b20778e265a8f2eba62d: Status 404 returned error can't find the container with id cb566fa10e379b2efd9e52194fe8fceda23ff17f8538b20778e265a8f2eba62d
Jul 30 17:01:57.709330 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:57.709298    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d4995675-zfsfh"
Jul 30 17:01:57.797682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:57.797641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m7z8" event={"ID":"3726abb7-66b3-4f85-bec8-f482c2cc5f27","Type":"ContainerStarted","Data":"cb566fa10e379b2efd9e52194fe8fceda23ff17f8538b20778e265a8f2eba62d"}
Jul 30 17:01:58.802496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:58.802455    2560 generic.go:356] "Generic (PLEG): container finished" podID="3726abb7-66b3-4f85-bec8-f482c2cc5f27" containerID="451bc5f4a5984fd7480e63a28b6827e8aae2ad3bc1c82a8a28633a64940e7818" exitCode=0
Jul 30 17:01:58.802887 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:58.802504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m7z8" event={"ID":"3726abb7-66b3-4f85-bec8-f482c2cc5f27","Type":"ContainerDied","Data":"451bc5f4a5984fd7480e63a28b6827e8aae2ad3bc1c82a8a28633a64940e7818"}
Jul 30 17:01:59.807651 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:59.807613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m7z8" event={"ID":"3726abb7-66b3-4f85-bec8-f482c2cc5f27","Type":"ContainerStarted","Data":"122d4592e42ce67ebebdf6dc8ac0a31514861fa7e285e787f6d38c553a91a511"}
Jul 30 17:01:59.808028 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:59.807715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m7z8" event={"ID":"3726abb7-66b3-4f85-bec8-f482c2cc5f27","Type":"ContainerStarted","Data":"ac0f30d0b979d80466362e9eb48874ddc7dae7838cf23f6f3a4ce6eb326bb060"}
Jul 30 17:01:59.829871 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:01:59.829809    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4m7z8" podStartSLOduration=2.6318473190000002 podStartE2EDuration="3.829794069s" totalImagesPullingTime="1.126906301s" totalInitContainerRuntime="71.040449ms" isStatefulPod=true podCreationTimestamp="2026-07-30 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:59.82876295 +0000 UTC m=+79.982005687" watchObservedRunningTime="2026-07-30 17:01:59.829794069 +0000 UTC m=+79.983036772"
Jul 30 17:02:00.851670 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:00.851596    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb" podUID="63ac5f58-00d4-43f0-94ae-287bdcc7deca" containerName="registry" containerID="cri-o://809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91" gracePeriod=30
Jul 30 17:02:01.089511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.089418    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:02:01.160236 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160205    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-certificates\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160245    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w92ct\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-kube-api-access-w92ct\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160287    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-installation-pull-secrets\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-trusted-ca\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63ac5f58-00d4-43f0-94ae-287bdcc7deca-ca-trust-extracted\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160370    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-image-registry-private-configuration\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160403    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160768 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160425    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-bound-sa-token\") pod \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\" (UID: \"63ac5f58-00d4-43f0-94ae-287bdcc7deca\") "
Jul 30 17:02:01.160768 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:01.160891 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.160861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:01.162967 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.162917    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-kube-api-access-w92ct" (OuterVolumeSpecName: "kube-api-access-w92ct") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "kube-api-access-w92ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:01.163143 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.163117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:01.163345 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.163317    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:02:01.163428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.163411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:02:01.163428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.163412    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:01.169255 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.169229    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ac5f58-00d4-43f0-94ae-287bdcc7deca-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "63ac5f58-00d4-43f0-94ae-287bdcc7deca" (UID: "63ac5f58-00d4-43f0-94ae-287bdcc7deca"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:02:01.261341 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261305    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-installation-pull-secrets\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261341 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261333    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-trusted-ca\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261341 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261342    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63ac5f58-00d4-43f0-94ae-287bdcc7deca-ca-trust-extracted\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261353    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63ac5f58-00d4-43f0-94ae-287bdcc7deca-image-registry-private-configuration\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261362    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261371    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-bound-sa-token\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261378    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63ac5f58-00d4-43f0-94ae-287bdcc7deca-registry-certificates\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.261567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.261386    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w92ct\" (UniqueName: \"kubernetes.io/projected/63ac5f58-00d4-43f0-94ae-287bdcc7deca-kube-api-access-w92ct\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:02:01.816220 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.816179    2560 generic.go:356] "Generic (PLEG): container finished" podID="63ac5f58-00d4-43f0-94ae-287bdcc7deca" containerID="809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91" exitCode=0
Jul 30 17:02:01.816220 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.816226    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb"
Jul 30 17:02:01.816452 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.816262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb" event={"ID":"63ac5f58-00d4-43f0-94ae-287bdcc7deca","Type":"ContainerDied","Data":"809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91"}
Jul 30 17:02:01.816452 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.816321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5f77796-bb7tb" event={"ID":"63ac5f58-00d4-43f0-94ae-287bdcc7deca","Type":"ContainerDied","Data":"0ea7be69ba09c929264c384518b613e864f66c17d0903def6c543d2a56aaaf4b"}
Jul 30 17:02:01.816452 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.816341    2560 scope.go:117] "RemoveContainer" containerID="809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91"
Jul 30 17:02:01.827594 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.827569    2560 scope.go:117] "RemoveContainer" containerID="809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91"
Jul 30 17:02:01.827910 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:02:01.827890    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91\": container with ID starting with 809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91 not found: ID does not exist" containerID="809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91"
Jul 30 17:02:01.827981 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.827922    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91"} err="failed to get container status \"809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91\": rpc error: code = NotFound desc = could not find container \"809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91\": container with ID starting with 809362acc6152206ad0827dfbfd574547c10fc88d06744ab3eab54ff6d891f91 not found: ID does not exist"
Jul 30 17:02:01.838832 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.838805    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d5f77796-bb7tb"]
Jul 30 17:02:01.845125 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:01.845099    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d5f77796-bb7tb"]
Jul 30 17:02:02.389390 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:02.389356    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ac5f58-00d4-43f0-94ae-287bdcc7deca" path="/var/lib/kubelet/pods/63ac5f58-00d4-43f0-94ae-287bdcc7deca/volumes"
Jul 30 17:02:23.785821 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:02:23.785792    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rn786"
Jul 30 17:05:40.224460 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:05:40.224433    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 17:07:53.617479 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.617446    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-rd555"]
Jul 30 17:07:53.617920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.617673    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac5f58-00d4-43f0-94ae-287bdcc7deca" containerName="registry"
Jul 30 17:07:53.617920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.617683    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac5f58-00d4-43f0-94ae-287bdcc7deca" containerName="registry"
Jul 30 17:07:53.617920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.617738    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ac5f58-00d4-43f0-94ae-287bdcc7deca" containerName="registry"
Jul 30 17:07:53.621312 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.620042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:53.623223 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.623198    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-tttxs\""
Jul 30 17:07:53.623223 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.623216    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 30 17:07:53.623583 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.623567    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 30 17:07:53.623658 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.623591    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 30 17:07:53.630522 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.630492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-rd555"]
Jul 30 17:07:53.636693 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.636673    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-8588677cfb-ptrn4"]
Jul 30 17:07:53.638476 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.638460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.640629 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.640608    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 30 17:07:53.640731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.640644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Jul 30 17:07:53.640731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.640665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-62t65\""
Jul 30 17:07:53.648319 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.648293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-8588677cfb-ptrn4"]
Jul 30 17:07:53.661472 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.661444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934373d5-16d8-4c54-bca1-33b9c47fcf63-tls-certs\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:53.661590 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.661484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4s95\" (UniqueName: \"kubernetes.io/projected/0ab450d4-7c91-4c10-9ee8-06450f10fd17-kube-api-access-z4s95\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.661590 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.661521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-metrics-certs\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.661590 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.661580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-cert\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.661723 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.661623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc5qp\" (UniqueName: \"kubernetes.io/projected/934373d5-16d8-4c54-bca1-33b9c47fcf63-kube-api-access-qc5qp\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:53.762728 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.762687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4s95\" (UniqueName: \"kubernetes.io/projected/0ab450d4-7c91-4c10-9ee8-06450f10fd17-kube-api-access-z4s95\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.762728 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.762729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-metrics-certs\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.762759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-cert\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.762790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc5qp\" (UniqueName: \"kubernetes.io/projected/934373d5-16d8-4c54-bca1-33b9c47fcf63-kube-api-access-qc5qp\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.762813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934373d5-16d8-4c54-bca1-33b9c47fcf63-tls-certs\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:07:53.762847    2560 secret.go:189] Couldn't get secret kserve/odh-model-controller-metrics-tls: secret "odh-model-controller-metrics-tls" not found
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:07:53.762905    2560 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:07:53.762944    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-metrics-certs podName:0ab450d4-7c91-4c10-9ee8-06450f10fd17 nodeName:}" failed. No retries permitted until 2026-07-30 17:07:54.262920298 +0000 UTC m=+434.416162997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-metrics-certs") pod "odh-model-controller-8588677cfb-ptrn4" (UID: "0ab450d4-7c91-4c10-9ee8-06450f10fd17") : secret "odh-model-controller-metrics-tls" not found
Jul 30 17:07:53.762959 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:07:53.762905    2560 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 30 17:07:53.763250 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:07:53.762966    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-cert podName:0ab450d4-7c91-4c10-9ee8-06450f10fd17 nodeName:}" failed. No retries permitted until 2026-07-30 17:07:54.262956485 +0000 UTC m=+434.416199166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-cert") pod "odh-model-controller-8588677cfb-ptrn4" (UID: "0ab450d4-7c91-4c10-9ee8-06450f10fd17") : secret "odh-model-controller-webhook-cert" not found
Jul 30 17:07:53.763250 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:07:53.762992    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/934373d5-16d8-4c54-bca1-33b9c47fcf63-tls-certs podName:934373d5-16d8-4c54-bca1-33b9c47fcf63 nodeName:}" failed. No retries permitted until 2026-07-30 17:07:54.262972882 +0000 UTC m=+434.416215567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/934373d5-16d8-4c54-bca1-33b9c47fcf63-tls-certs") pod "model-serving-api-7b954ffc95-rd555" (UID: "934373d5-16d8-4c54-bca1-33b9c47fcf63") : secret "model-serving-api-tls" not found
Jul 30 17:07:53.771411 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.771383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4s95\" (UniqueName: \"kubernetes.io/projected/0ab450d4-7c91-4c10-9ee8-06450f10fd17-kube-api-access-z4s95\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:53.771411 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:53.771411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc5qp\" (UniqueName: \"kubernetes.io/projected/934373d5-16d8-4c54-bca1-33b9c47fcf63-kube-api-access-qc5qp\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:54.265968 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.265933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-cert\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:54.266208 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.266006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934373d5-16d8-4c54-bca1-33b9c47fcf63-tls-certs\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:54.266208 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.266055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-metrics-certs\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:54.268832 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.268800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/934373d5-16d8-4c54-bca1-33b9c47fcf63-tls-certs\") pod \"model-serving-api-7b954ffc95-rd555\" (UID: \"934373d5-16d8-4c54-bca1-33b9c47fcf63\") " pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:54.268832 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.268821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-metrics-certs\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:54.268996 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.268827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ab450d4-7c91-4c10-9ee8-06450f10fd17-cert\") pod \"odh-model-controller-8588677cfb-ptrn4\" (UID: \"0ab450d4-7c91-4c10-9ee8-06450f10fd17\") " pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:54.532999 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.532893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:54.549026 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.548999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:54.667721 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.667699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-rd555"]
Jul 30 17:07:54.670378 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:07:54.670352    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934373d5_16d8_4c54_bca1_33b9c47fcf63.slice/crio-c74ab5c9748842c704012e744aef5a74c46c3d28a39445e31469c3e42e9b7bf4 WatchSource:0}: Error finding container c74ab5c9748842c704012e744aef5a74c46c3d28a39445e31469c3e42e9b7bf4: Status 404 returned error can't find the container with id c74ab5c9748842c704012e744aef5a74c46c3d28a39445e31469c3e42e9b7bf4
Jul 30 17:07:54.672179 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.672136    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:07:54.686280 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.686205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-8588677cfb-ptrn4"]
Jul 30 17:07:54.688132 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:07:54.688113    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab450d4_7c91_4c10_9ee8_06450f10fd17.slice/crio-6a70b9795ce9b9ddb2fdf28c4a2f757169b70e8ea01379584989ec1065b2ff0b WatchSource:0}: Error finding container 6a70b9795ce9b9ddb2fdf28c4a2f757169b70e8ea01379584989ec1065b2ff0b: Status 404 returned error can't find the container with id 6a70b9795ce9b9ddb2fdf28c4a2f757169b70e8ea01379584989ec1065b2ff0b
Jul 30 17:07:54.966425 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.966388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-rd555" event={"ID":"934373d5-16d8-4c54-bca1-33b9c47fcf63","Type":"ContainerStarted","Data":"c74ab5c9748842c704012e744aef5a74c46c3d28a39445e31469c3e42e9b7bf4"}
Jul 30 17:07:54.967464 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:54.967440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-8588677cfb-ptrn4" event={"ID":"0ab450d4-7c91-4c10-9ee8-06450f10fd17","Type":"ContainerStarted","Data":"6a70b9795ce9b9ddb2fdf28c4a2f757169b70e8ea01379584989ec1065b2ff0b"}
Jul 30 17:07:58.983868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:58.983823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-8588677cfb-ptrn4" event={"ID":"0ab450d4-7c91-4c10-9ee8-06450f10fd17","Type":"ContainerStarted","Data":"8b7418c67f54f8b6b98bd11e24b4973489bebad2847a23a4209b09929d6bb0a8"}
Jul 30 17:07:58.984353 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:58.983915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:07:58.985386 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:58.985361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-rd555" event={"ID":"934373d5-16d8-4c54-bca1-33b9c47fcf63","Type":"ContainerStarted","Data":"b62f68cba51c1920ba94fafaa53f0a1818806171e58955dd6c3b2db71c70533d"}
Jul 30 17:07:58.985496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:58.985410    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:07:58.999413 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:58.999346    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-8588677cfb-ptrn4" podStartSLOduration=2.320634458 podStartE2EDuration="5.999329568s" totalImagesPullingTime="3.67869511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:07:58.998805777 +0000 UTC m=+439.152048483" watchObservedRunningTime="2026-07-30 17:07:58.999329568 +0000 UTC m=+439.152572271"
Jul 30 17:07:59.013771 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:07:59.013728    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-rd555" podStartSLOduration=2.326595256 podStartE2EDuration="6.013714201s" totalImagesPullingTime="3.687118945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:07:59.012930559 +0000 UTC m=+439.166173264" watchObservedRunningTime="2026-07-30 17:07:59.013714201 +0000 UTC m=+439.166956904"
Jul 30 17:08:09.991106 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:08:09.991031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-8588677cfb-ptrn4"
Jul 30 17:08:09.992936 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:08:09.992917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-rd555"
Jul 30 17:09:42.775602 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.775528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"]
Jul 30 17:09:42.777963 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.777947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.780196 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.780168    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-74452-predictor-serving-cert\""
Jul 30 17:09:42.780343 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.780330    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 30 17:09:42.780401 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.780350    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 30 17:09:42.780868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.780851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qvl2g\""
Jul 30 17:09:42.780969 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.780853    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-74452-kube-rbac-proxy-sar-config\""
Jul 30 17:09:42.787222 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.787199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"]
Jul 30 17:09:42.832056 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.832026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.832247 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.832063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/182d235a-fae8-4526-bf30-513f8ab71990-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.832247 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.832100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdbbx\" (UniqueName: \"kubernetes.io/projected/182d235a-fae8-4526-bf30-513f8ab71990-kube-api-access-jdbbx\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.932796 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.932753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdbbx\" (UniqueName: \"kubernetes.io/projected/182d235a-fae8-4526-bf30-513f8ab71990-kube-api-access-jdbbx\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.932981 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.932856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.932981 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.932885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/182d235a-fae8-4526-bf30-513f8ab71990-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.933093 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:09:42.932992    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-74452-predictor-serving-cert: secret "success-200-isvc-74452-predictor-serving-cert" not found
Jul 30 17:09:42.933093 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:09:42.933058    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls podName:182d235a-fae8-4526-bf30-513f8ab71990 nodeName:}" failed. No retries permitted until 2026-07-30 17:09:43.433041579 +0000 UTC m=+543.586284261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls") pod "success-200-isvc-74452-predictor-79b7494897-vlzrj" (UID: "182d235a-fae8-4526-bf30-513f8ab71990") : secret "success-200-isvc-74452-predictor-serving-cert" not found
Jul 30 17:09:42.933594 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.933571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/182d235a-fae8-4526-bf30-513f8ab71990-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:42.941648 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:42.941623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdbbx\" (UniqueName: \"kubernetes.io/projected/182d235a-fae8-4526-bf30-513f8ab71990-kube-api-access-jdbbx\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:43.437430 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:43.437391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:43.439951 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:43.439921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls\") pod \"success-200-isvc-74452-predictor-79b7494897-vlzrj\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") " pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:43.688419 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:43.688333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:43.817212 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:43.817180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"]
Jul 30 17:09:43.820820 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:09:43.820789    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182d235a_fae8_4526_bf30_513f8ab71990.slice/crio-cdc5bab208f90d64e00f6fc55edb914188b81efefc6c675d9e0de09c5aa9b57d WatchSource:0}: Error finding container cdc5bab208f90d64e00f6fc55edb914188b81efefc6c675d9e0de09c5aa9b57d: Status 404 returned error can't find the container with id cdc5bab208f90d64e00f6fc55edb914188b81efefc6c675d9e0de09c5aa9b57d
Jul 30 17:09:44.337462 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:44.337421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" event={"ID":"182d235a-fae8-4526-bf30-513f8ab71990","Type":"ContainerStarted","Data":"cdc5bab208f90d64e00f6fc55edb914188b81efefc6c675d9e0de09c5aa9b57d"}
Jul 30 17:09:56.389391 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:56.389306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" event={"ID":"182d235a-fae8-4526-bf30-513f8ab71990","Type":"ContainerStarted","Data":"621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047"}
Jul 30 17:09:59.404202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:59.404139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" event={"ID":"182d235a-fae8-4526-bf30-513f8ab71990","Type":"ContainerStarted","Data":"21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479"}
Jul 30 17:09:59.404621 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:59.404230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:59.404621 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:59.404253    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:09:59.405501 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:59.405470    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Jul 30 17:09:59.420400 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:09:59.420327    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podStartSLOduration=2.665490277 podStartE2EDuration="17.420309287s" totalImagesPullingTime="14.75481901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:09:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:09:59.419719852 +0000 UTC m=+559.572962555" watchObservedRunningTime="2026-07-30 17:09:59.420309287 +0000 UTC m=+559.573551992"
Jul 30 17:10:00.407549 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:00.407507    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Jul 30 17:10:05.413418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:05.413390    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:10:05.413849 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:05.413819    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Jul 30 17:10:15.414319 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:15.414281    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Jul 30 17:10:25.414664 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:25.414610    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Jul 30 17:10:35.413829 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:35.413782    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Jul 30 17:10:45.414894 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:10:45.414866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:11:02.570648 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.570575    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"]
Jul 30 17:11:02.572639 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.572622    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:02.574910 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.574886    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-74452-kube-rbac-proxy-sar-config\""
Jul 30 17:11:02.575032 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.574888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-74452-serving-cert\""
Jul 30 17:11:02.581034 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.581009    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"]
Jul 30 17:11:02.632245 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.632213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe84a095-9c90-4dd2-b800-32b324d16232-openshift-service-ca-bundle\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:02.632414 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.632254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:02.733567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.733530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe84a095-9c90-4dd2-b800-32b324d16232-openshift-service-ca-bundle\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:02.733720 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.733577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:02.733720 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:11:02.733690    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-74452-serving-cert: secret "switch-graph-74452-serving-cert" not found
Jul 30 17:11:02.733815 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:11:02.733804    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls podName:fe84a095-9c90-4dd2-b800-32b324d16232 nodeName:}" failed. No retries permitted until 2026-07-30 17:11:03.233779992 +0000 UTC m=+623.387022674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls") pod "switch-graph-74452-6f6c57c8-lptzm" (UID: "fe84a095-9c90-4dd2-b800-32b324d16232") : secret "switch-graph-74452-serving-cert" not found
Jul 30 17:11:02.734274 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:02.734255    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe84a095-9c90-4dd2-b800-32b324d16232-openshift-service-ca-bundle\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:03.237835 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:03.237783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:03.238015 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:11:03.237926    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-74452-serving-cert: secret "switch-graph-74452-serving-cert" not found
Jul 30 17:11:03.238015 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:11:03.237995    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls podName:fe84a095-9c90-4dd2-b800-32b324d16232 nodeName:}" failed. No retries permitted until 2026-07-30 17:11:04.237979063 +0000 UTC m=+624.391221744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls") pod "switch-graph-74452-6f6c57c8-lptzm" (UID: "fe84a095-9c90-4dd2-b800-32b324d16232") : secret "switch-graph-74452-serving-cert" not found
Jul 30 17:11:04.245599 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:04.245559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:04.248088 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:04.248058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") pod \"switch-graph-74452-6f6c57c8-lptzm\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") " pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:04.383509 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:04.383467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:04.509185 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:04.509083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"]
Jul 30 17:11:04.511724 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:11:04.511689    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe84a095_9c90_4dd2_b800_32b324d16232.slice/crio-a64bb0122e1ba90dabfaf658a3c9d2d1001020ec2f9e5da9efb04bee63a68542 WatchSource:0}: Error finding container a64bb0122e1ba90dabfaf658a3c9d2d1001020ec2f9e5da9efb04bee63a68542: Status 404 returned error can't find the container with id a64bb0122e1ba90dabfaf658a3c9d2d1001020ec2f9e5da9efb04bee63a68542
Jul 30 17:11:04.630852 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:04.630819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" event={"ID":"fe84a095-9c90-4dd2-b800-32b324d16232","Type":"ContainerStarted","Data":"a64bb0122e1ba90dabfaf658a3c9d2d1001020ec2f9e5da9efb04bee63a68542"}
Jul 30 17:11:06.639768 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:06.639734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" event={"ID":"fe84a095-9c90-4dd2-b800-32b324d16232","Type":"ContainerStarted","Data":"e5a3083cf550b38d70f9ec2ac570e7924a747245791d7c477ec0ad2f1ca541aa"}
Jul 30 17:11:06.640272 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:06.639861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:06.655223 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:06.655138    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podStartSLOduration=2.64090379 podStartE2EDuration="4.655122089s" totalImagesPullingTime="2.014218299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:11:06.654891525 +0000 UTC m=+626.808134230" watchObservedRunningTime="2026-07-30 17:11:06.655122089 +0000 UTC m=+626.808364791"
Jul 30 17:11:12.648959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:12.648924    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:16.708401 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.708370    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"]
Jul 30 17:11:16.708928 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.708591    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" containerID="cri-o://e5a3083cf550b38d70f9ec2ac570e7924a747245791d7c477ec0ad2f1ca541aa" gracePeriod=30
Jul 30 17:11:16.855884 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.855847    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"]
Jul 30 17:11:16.856114 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.856070    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container" containerID="cri-o://621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047" gracePeriod=30
Jul 30 17:11:16.856213 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.856104    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kube-rbac-proxy" containerID="cri-o://21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479" gracePeriod=30
Jul 30 17:11:16.899212 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.899180    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"]
Jul 30 17:11:16.901484 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.901465    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:16.903856 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.903836    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8bf5c-kube-rbac-proxy-sar-config\""
Jul 30 17:11:16.904113 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.904092    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8bf5c-predictor-serving-cert\""
Jul 30 17:11:16.912608 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.912579    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"]
Jul 30 17:11:16.939255 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.939224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85b9dffd-22ca-4623-bab8-4b5e3aede126-proxy-tls\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:16.939402 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.939288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppj58\" (UniqueName: \"kubernetes.io/projected/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-api-access-ppj58\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:16.939402 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:16.939315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.040509 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.040466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppj58\" (UniqueName: \"kubernetes.io/projected/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-api-access-ppj58\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.040719 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.040520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.040719 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.040591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85b9dffd-22ca-4623-bab8-4b5e3aede126-proxy-tls\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.041244 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.041220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.043165 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.043125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85b9dffd-22ca-4623-bab8-4b5e3aede126-proxy-tls\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.053126 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.053100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppj58\" (UniqueName: \"kubernetes.io/projected/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-api-access-ppj58\") pod \"success-200-isvc-8bf5c-predictor-696548fcc7-ntglx\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") " pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.212039 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.212006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.347945 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.347919    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"]
Jul 30 17:11:17.350491 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:11:17.350462    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b9dffd_22ca_4623_bab8_4b5e3aede126.slice/crio-8e2ceb3eb24ba1ad8ef4260a06d46fb21e103aa169443b0c9799da4014a5dfdb WatchSource:0}: Error finding container 8e2ceb3eb24ba1ad8ef4260a06d46fb21e103aa169443b0c9799da4014a5dfdb: Status 404 returned error can't find the container with id 8e2ceb3eb24ba1ad8ef4260a06d46fb21e103aa169443b0c9799da4014a5dfdb
Jul 30 17:11:17.647967 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.647877    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:11:17.677690 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.677660    2560 generic.go:356] "Generic (PLEG): container finished" podID="182d235a-fae8-4526-bf30-513f8ab71990" containerID="21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479" exitCode=2
Jul 30 17:11:17.677873 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.677719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" event={"ID":"182d235a-fae8-4526-bf30-513f8ab71990","Type":"ContainerDied","Data":"21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479"}
Jul 30 17:11:17.679567 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.679540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" event={"ID":"85b9dffd-22ca-4623-bab8-4b5e3aede126","Type":"ContainerStarted","Data":"9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2"}
Jul 30 17:11:17.679700 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.679596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" event={"ID":"85b9dffd-22ca-4623-bab8-4b5e3aede126","Type":"ContainerStarted","Data":"55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc"}
Jul 30 17:11:17.679700 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.679621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" event={"ID":"85b9dffd-22ca-4623-bab8-4b5e3aede126","Type":"ContainerStarted","Data":"8e2ceb3eb24ba1ad8ef4260a06d46fb21e103aa169443b0c9799da4014a5dfdb"}
Jul 30 17:11:17.679700 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.679684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:17.697905 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:17.697856    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podStartSLOduration=1.6978399610000001 podStartE2EDuration="1.697839961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:11:17.696060193 +0000 UTC m=+637.849302908" watchObservedRunningTime="2026-07-30 17:11:17.697839961 +0000 UTC m=+637.851082664"
Jul 30 17:11:18.682881 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:18.682846    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:18.684203 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:18.684168    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:11:19.686574 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:19.686530    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:11:20.203786 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.203756    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:11:20.266838 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.266798    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdbbx\" (UniqueName: \"kubernetes.io/projected/182d235a-fae8-4526-bf30-513f8ab71990-kube-api-access-jdbbx\") pod \"182d235a-fae8-4526-bf30-513f8ab71990\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") "
Jul 30 17:11:20.266838 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.266845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/182d235a-fae8-4526-bf30-513f8ab71990-kube-rbac-proxy-sar-config\") pod \"182d235a-fae8-4526-bf30-513f8ab71990\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") "
Jul 30 17:11:20.267088 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.266884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls\") pod \"182d235a-fae8-4526-bf30-513f8ab71990\" (UID: \"182d235a-fae8-4526-bf30-513f8ab71990\") "
Jul 30 17:11:20.267294 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.267267    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/182d235a-fae8-4526-bf30-513f8ab71990-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "182d235a-fae8-4526-bf30-513f8ab71990" (UID: "182d235a-fae8-4526-bf30-513f8ab71990"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:11:20.269290 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.269269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "182d235a-fae8-4526-bf30-513f8ab71990" (UID: "182d235a-fae8-4526-bf30-513f8ab71990"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:11:20.269290 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.269269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/182d235a-fae8-4526-bf30-513f8ab71990-kube-api-access-jdbbx" (OuterVolumeSpecName: "kube-api-access-jdbbx") pod "182d235a-fae8-4526-bf30-513f8ab71990" (UID: "182d235a-fae8-4526-bf30-513f8ab71990"). InnerVolumeSpecName "kube-api-access-jdbbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:11:20.367363 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.367274    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdbbx\" (UniqueName: \"kubernetes.io/projected/182d235a-fae8-4526-bf30-513f8ab71990-kube-api-access-jdbbx\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:11:20.367363 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.367305    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/182d235a-fae8-4526-bf30-513f8ab71990-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:11:20.367363 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.367316    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/182d235a-fae8-4526-bf30-513f8ab71990-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:11:20.691372 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.691340    2560 generic.go:356] "Generic (PLEG): container finished" podID="182d235a-fae8-4526-bf30-513f8ab71990" containerID="621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047" exitCode=0
Jul 30 17:11:20.691766 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.691390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"
Jul 30 17:11:20.691766 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.691409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" event={"ID":"182d235a-fae8-4526-bf30-513f8ab71990","Type":"ContainerDied","Data":"621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047"}
Jul 30 17:11:20.691766 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.691457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj" event={"ID":"182d235a-fae8-4526-bf30-513f8ab71990","Type":"ContainerDied","Data":"cdc5bab208f90d64e00f6fc55edb914188b81efefc6c675d9e0de09c5aa9b57d"}
Jul 30 17:11:20.691766 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.691487    2560 scope.go:117] "RemoveContainer" containerID="21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479"
Jul 30 17:11:20.699491 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.699469    2560 scope.go:117] "RemoveContainer" containerID="621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047"
Jul 30 17:11:20.706985 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.706963    2560 scope.go:117] "RemoveContainer" containerID="21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479"
Jul 30 17:11:20.707338 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:11:20.707314    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479\": container with ID starting with 21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479 not found: ID does not exist" containerID="21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479"
Jul 30 17:11:20.707428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.707350    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479"} err="failed to get container status \"21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479\": rpc error: code = NotFound desc = could not find container \"21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479\": container with ID starting with 21d0454277c377c4b14256572b7845df01100fb7688a267f5757fd4a1763b479 not found: ID does not exist"
Jul 30 17:11:20.707428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.707375    2560 scope.go:117] "RemoveContainer" containerID="621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047"
Jul 30 17:11:20.707564 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.707544    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"]
Jul 30 17:11:20.707650 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:11:20.707633    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047\": container with ID starting with 621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047 not found: ID does not exist" containerID="621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047"
Jul 30 17:11:20.707691 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.707658    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047"} err="failed to get container status \"621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047\": rpc error: code = NotFound desc = could not find container \"621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047\": container with ID starting with 621e99e4286053b8076c300b45e07b2c5377c2849edcae33f8952ebd3df38047 not found: ID does not exist"
Jul 30 17:11:20.711625 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:20.711605    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-74452-predictor-79b7494897-vlzrj"]
Jul 30 17:11:22.389842 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:22.389812    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="182d235a-fae8-4526-bf30-513f8ab71990" path="/var/lib/kubelet/pods/182d235a-fae8-4526-bf30-513f8ab71990/volumes"
Jul 30 17:11:22.647375 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:22.647286    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:11:24.691550 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:24.691524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:11:24.692099 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:24.692071    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:11:27.647678 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:27.647633    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:11:27.648058 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:27.647759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:32.647078 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:32.647041    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:11:34.693089 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:34.693047    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:11:37.647655 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:37.647616    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:11:42.646998 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:42.646959    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:11:44.692813 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:44.692768    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:11:46.785359 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.785322    2560 generic.go:356] "Generic (PLEG): container finished" podID="fe84a095-9c90-4dd2-b800-32b324d16232" containerID="e5a3083cf550b38d70f9ec2ac570e7924a747245791d7c477ec0ad2f1ca541aa" exitCode=0
Jul 30 17:11:46.785721 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.785375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" event={"ID":"fe84a095-9c90-4dd2-b800-32b324d16232","Type":"ContainerDied","Data":"e5a3083cf550b38d70f9ec2ac570e7924a747245791d7c477ec0ad2f1ca541aa"}
Jul 30 17:11:46.857277 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.857252    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:46.977674 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.977582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe84a095-9c90-4dd2-b800-32b324d16232-openshift-service-ca-bundle\") pod \"fe84a095-9c90-4dd2-b800-32b324d16232\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") "
Jul 30 17:11:46.977674 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.977645    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") pod \"fe84a095-9c90-4dd2-b800-32b324d16232\" (UID: \"fe84a095-9c90-4dd2-b800-32b324d16232\") "
Jul 30 17:11:46.978010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.977985    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe84a095-9c90-4dd2-b800-32b324d16232-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fe84a095-9c90-4dd2-b800-32b324d16232" (UID: "fe84a095-9c90-4dd2-b800-32b324d16232"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:11:46.979786 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:46.979752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fe84a095-9c90-4dd2-b800-32b324d16232" (UID: "fe84a095-9c90-4dd2-b800-32b324d16232"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:11:47.078428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.078390    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe84a095-9c90-4dd2-b800-32b324d16232-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:11:47.078428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.078420    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe84a095-9c90-4dd2-b800-32b324d16232-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:11:47.789916 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.789885    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"
Jul 30 17:11:47.789916 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.789903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm" event={"ID":"fe84a095-9c90-4dd2-b800-32b324d16232","Type":"ContainerDied","Data":"a64bb0122e1ba90dabfaf658a3c9d2d1001020ec2f9e5da9efb04bee63a68542"}
Jul 30 17:11:47.790423 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.789959    2560 scope.go:117] "RemoveContainer" containerID="e5a3083cf550b38d70f9ec2ac570e7924a747245791d7c477ec0ad2f1ca541aa"
Jul 30 17:11:47.810189 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.810138    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"]
Jul 30 17:11:47.815977 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:47.815953    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-74452-6f6c57c8-lptzm"]
Jul 30 17:11:48.390352 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:48.390316    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" path="/var/lib/kubelet/pods/fe84a095-9c90-4dd2-b800-32b324d16232/volumes"
Jul 30 17:11:54.693088 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:11:54.693046    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:12:02.615000 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.614970    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"]
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615307    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615321    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615330    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kube-rbac-proxy"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615337    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kube-rbac-proxy"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615345    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615350    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615396    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kserve-container"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615404    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe84a095-9c90-4dd2-b800-32b324d16232" containerName="switch-graph-74452"
Jul 30 17:12:02.615502 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.615410    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="182d235a-fae8-4526-bf30-513f8ab71990" containerName="kube-rbac-proxy"
Jul 30 17:12:02.619508 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.619493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.621715 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.621699    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 30 17:12:02.621793 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.621703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 30 17:12:02.626715 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.626690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"]
Jul 30 17:12:02.796602 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.796565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead23545-faaf-4208-9426-1fe45aab1637-openshift-service-ca-bundle\") pod \"model-chainer-74c6ff67b5-gcqng\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") " pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.796602 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.796603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ead23545-faaf-4208-9426-1fe45aab1637-proxy-tls\") pod \"model-chainer-74c6ff67b5-gcqng\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") " pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.897823 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.897736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead23545-faaf-4208-9426-1fe45aab1637-openshift-service-ca-bundle\") pod \"model-chainer-74c6ff67b5-gcqng\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") " pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.897823 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.897781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ead23545-faaf-4208-9426-1fe45aab1637-proxy-tls\") pod \"model-chainer-74c6ff67b5-gcqng\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") " pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.898511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.898493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead23545-faaf-4208-9426-1fe45aab1637-openshift-service-ca-bundle\") pod \"model-chainer-74c6ff67b5-gcqng\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") " pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.900323 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.900306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ead23545-faaf-4208-9426-1fe45aab1637-proxy-tls\") pod \"model-chainer-74c6ff67b5-gcqng\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") " pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:02.930306 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:02.930265    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:03.073200 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:03.073164    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"]
Jul 30 17:12:03.076002 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:12:03.075976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead23545_faaf_4208_9426_1fe45aab1637.slice/crio-51e2aefdb52889de4becf6b4ed7c32d3b278a99e23b80f7028dea743ed60d5f6 WatchSource:0}: Error finding container 51e2aefdb52889de4becf6b4ed7c32d3b278a99e23b80f7028dea743ed60d5f6: Status 404 returned error can't find the container with id 51e2aefdb52889de4becf6b4ed7c32d3b278a99e23b80f7028dea743ed60d5f6
Jul 30 17:12:03.844205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:03.844144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" event={"ID":"ead23545-faaf-4208-9426-1fe45aab1637","Type":"ContainerStarted","Data":"bc36cd85fc5d3db1d6019226d6050ee016bfb4344679647946fec563dd9b49ff"}
Jul 30 17:12:03.844592 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:03.844225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" event={"ID":"ead23545-faaf-4208-9426-1fe45aab1637","Type":"ContainerStarted","Data":"51e2aefdb52889de4becf6b4ed7c32d3b278a99e23b80f7028dea743ed60d5f6"}
Jul 30 17:12:03.844592 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:03.844268    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:03.861142 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:03.861094    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podStartSLOduration=1.8610799199999999 podStartE2EDuration="1.86107992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:12:03.860409195 +0000 UTC m=+684.013651899" watchObservedRunningTime="2026-07-30 17:12:03.86107992 +0000 UTC m=+684.014322623"
Jul 30 17:12:04.693315 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:04.693283    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:12:09.853614 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:09.853590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:12.716764 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.716723    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"]
Jul 30 17:12:12.717252 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.716927    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" containerID="cri-o://bc36cd85fc5d3db1d6019226d6050ee016bfb4344679647946fec563dd9b49ff" gracePeriod=30
Jul 30 17:12:12.946759 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.946727    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"]
Jul 30 17:12:12.950337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.950316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:12.952447 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.952418    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9ae38-predictor-serving-cert\""
Jul 30 17:12:12.952575 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.952442    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9ae38-kube-rbac-proxy-sar-config\""
Jul 30 17:12:12.959873 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.959841    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"]
Jul 30 17:12:12.981043 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.980963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:12.981043 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.981008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:12.981247 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:12.981052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd4tw\" (UniqueName: \"kubernetes.io/projected/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-api-access-bd4tw\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.081427 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.081393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.081606 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.081440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.081606 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:12:13.081535    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-serving-cert: secret "success-200-isvc-9ae38-predictor-serving-cert" not found
Jul 30 17:12:13.081606 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.081596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd4tw\" (UniqueName: \"kubernetes.io/projected/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-api-access-bd4tw\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.081766 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:12:13.081683    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls podName:256075e0-ab2b-4edd-86f0-c529c460aa1e nodeName:}" failed. No retries permitted until 2026-07-30 17:12:13.581660425 +0000 UTC m=+693.734903113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls") pod "success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" (UID: "256075e0-ab2b-4edd-86f0-c529c460aa1e") : secret "success-200-isvc-9ae38-predictor-serving-cert" not found
Jul 30 17:12:13.082215 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.082194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.089428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.089409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd4tw\" (UniqueName: \"kubernetes.io/projected/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-api-access-bd4tw\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.585988 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.585957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.588368 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.588339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls\") pod \"success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") " pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.861601 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.861493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:13.994513 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:13.994479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"]
Jul 30 17:12:13.997829 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:12:13.997796    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256075e0_ab2b_4edd_86f0_c529c460aa1e.slice/crio-f40046838731700e338dd64a410fcf2c8ad688f9764139f58ccbf81935c7e9e6 WatchSource:0}: Error finding container f40046838731700e338dd64a410fcf2c8ad688f9764139f58ccbf81935c7e9e6: Status 404 returned error can't find the container with id f40046838731700e338dd64a410fcf2c8ad688f9764139f58ccbf81935c7e9e6
Jul 30 17:12:14.852348 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:14.852306    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:12:14.885460 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:14.885420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" event={"ID":"256075e0-ab2b-4edd-86f0-c529c460aa1e","Type":"ContainerStarted","Data":"d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a"}
Jul 30 17:12:14.885831 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:14.885486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" event={"ID":"256075e0-ab2b-4edd-86f0-c529c460aa1e","Type":"ContainerStarted","Data":"d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba"}
Jul 30 17:12:14.885831 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:14.885526    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:14.885831 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:14.885555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" event={"ID":"256075e0-ab2b-4edd-86f0-c529c460aa1e","Type":"ContainerStarted","Data":"f40046838731700e338dd64a410fcf2c8ad688f9764139f58ccbf81935c7e9e6"}
Jul 30 17:12:14.901139 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:14.901060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podStartSLOduration=2.901032739 podStartE2EDuration="2.901032739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:12:14.9004898 +0000 UTC m=+695.053732502" watchObservedRunningTime="2026-07-30 17:12:14.901032739 +0000 UTC m=+695.054275442"
Jul 30 17:12:15.889786 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:15.889755    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:15.891045 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:15.891019    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 30 17:12:16.893484 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:16.893440    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 30 17:12:16.934507 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:16.934477    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"]
Jul 30 17:12:16.942840 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:16.942780    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:16.945283 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:16.945256    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-8bf5c-serving-cert\""
Jul 30 17:12:16.945445 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:16.945375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"]
Jul 30 17:12:16.945523 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:16.945515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-8bf5c-kube-rbac-proxy-sar-config\""
Jul 30 17:12:17.009334 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.009302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a405a1c-b348-4a32-8365-0d931ae4eae7-proxy-tls\") pod \"switch-graph-8bf5c-5dd585f497-dvlv7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") " pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.009527 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.009349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a405a1c-b348-4a32-8365-0d931ae4eae7-openshift-service-ca-bundle\") pod \"switch-graph-8bf5c-5dd585f497-dvlv7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") " pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.110220 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.110183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a405a1c-b348-4a32-8365-0d931ae4eae7-proxy-tls\") pod \"switch-graph-8bf5c-5dd585f497-dvlv7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") " pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.110371 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.110235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a405a1c-b348-4a32-8365-0d931ae4eae7-openshift-service-ca-bundle\") pod \"switch-graph-8bf5c-5dd585f497-dvlv7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") " pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.110967 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.110904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a405a1c-b348-4a32-8365-0d931ae4eae7-openshift-service-ca-bundle\") pod \"switch-graph-8bf5c-5dd585f497-dvlv7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") " pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.112734 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.112710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a405a1c-b348-4a32-8365-0d931ae4eae7-proxy-tls\") pod \"switch-graph-8bf5c-5dd585f497-dvlv7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") " pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.253839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.253798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.387063 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.387040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"]
Jul 30 17:12:17.389298 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:12:17.389270    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a405a1c_b348_4a32_8365_0d931ae4eae7.slice/crio-2aa4217617ac1ca99c2ea98dfeb93e8a17e4c72c1702ee9d342c53c0f108da87 WatchSource:0}: Error finding container 2aa4217617ac1ca99c2ea98dfeb93e8a17e4c72c1702ee9d342c53c0f108da87: Status 404 returned error can't find the container with id 2aa4217617ac1ca99c2ea98dfeb93e8a17e4c72c1702ee9d342c53c0f108da87
Jul 30 17:12:17.897963 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.897925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" event={"ID":"7a405a1c-b348-4a32-8365-0d931ae4eae7","Type":"ContainerStarted","Data":"f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935"}
Jul 30 17:12:17.898450 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.897984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" event={"ID":"7a405a1c-b348-4a32-8365-0d931ae4eae7","Type":"ContainerStarted","Data":"2aa4217617ac1ca99c2ea98dfeb93e8a17e4c72c1702ee9d342c53c0f108da87"}
Jul 30 17:12:17.898450 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.898078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:17.913450 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:17.913402    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podStartSLOduration=1.913388183 podStartE2EDuration="1.913388183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:12:17.912630449 +0000 UTC m=+698.065873155" watchObservedRunningTime="2026-07-30 17:12:17.913388183 +0000 UTC m=+698.066630885"
Jul 30 17:12:19.851902 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:19.851862    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:12:21.897602 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:21.897572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:12:21.898064 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:21.898036    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 30 17:12:23.907337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:23.907308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:12:24.852436 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:24.852398    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:12:24.852580 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:24.852506    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:29.851986 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:29.851948    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:12:31.898587 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:31.898499    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 30 17:12:34.852727 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:34.852689    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:12:39.852422 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:39.852382    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:12:41.898324 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:41.898281    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 30 17:12:42.989813 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:42.989729    2560 generic.go:356] "Generic (PLEG): container finished" podID="ead23545-faaf-4208-9426-1fe45aab1637" containerID="bc36cd85fc5d3db1d6019226d6050ee016bfb4344679647946fec563dd9b49ff" exitCode=0
Jul 30 17:12:42.990173 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:42.989817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" event={"ID":"ead23545-faaf-4208-9426-1fe45aab1637","Type":"ContainerDied","Data":"bc36cd85fc5d3db1d6019226d6050ee016bfb4344679647946fec563dd9b49ff"}
Jul 30 17:12:43.364638 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.364613    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:43.514942 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.514910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ead23545-faaf-4208-9426-1fe45aab1637-proxy-tls\") pod \"ead23545-faaf-4208-9426-1fe45aab1637\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") "
Jul 30 17:12:43.515120 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.514972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead23545-faaf-4208-9426-1fe45aab1637-openshift-service-ca-bundle\") pod \"ead23545-faaf-4208-9426-1fe45aab1637\" (UID: \"ead23545-faaf-4208-9426-1fe45aab1637\") "
Jul 30 17:12:43.515372 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.515349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead23545-faaf-4208-9426-1fe45aab1637-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ead23545-faaf-4208-9426-1fe45aab1637" (UID: "ead23545-faaf-4208-9426-1fe45aab1637"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:12:43.517060 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.517036    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead23545-faaf-4208-9426-1fe45aab1637-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ead23545-faaf-4208-9426-1fe45aab1637" (UID: "ead23545-faaf-4208-9426-1fe45aab1637"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:12:43.616244 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.616136    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ead23545-faaf-4208-9426-1fe45aab1637-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:12:43.616244 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.616188    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ead23545-faaf-4208-9426-1fe45aab1637-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:12:43.994985 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.994953    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"
Jul 30 17:12:43.995453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.994950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng" event={"ID":"ead23545-faaf-4208-9426-1fe45aab1637","Type":"ContainerDied","Data":"51e2aefdb52889de4becf6b4ed7c32d3b278a99e23b80f7028dea743ed60d5f6"}
Jul 30 17:12:43.995453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:43.995128    2560 scope.go:117] "RemoveContainer" containerID="bc36cd85fc5d3db1d6019226d6050ee016bfb4344679647946fec563dd9b49ff"
Jul 30 17:12:44.016416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:44.016384    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"]
Jul 30 17:12:44.020546 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:44.020523    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-74c6ff67b5-gcqng"]
Jul 30 17:12:44.390106 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:44.390027    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead23545-faaf-4208-9426-1fe45aab1637" path="/var/lib/kubelet/pods/ead23545-faaf-4208-9426-1fe45aab1637/volumes"
Jul 30 17:12:51.898430 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:12:51.898385    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 30 17:13:01.899299 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:01.899266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:13:12.963953 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.963916    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"]
Jul 30 17:13:12.964416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.964230    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer"
Jul 30 17:13:12.964416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.964241    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer"
Jul 30 17:13:12.964416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.964285    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead23545-faaf-4208-9426-1fe45aab1637" containerName="model-chainer"
Jul 30 17:13:12.967020 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.967004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:12.969453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.969432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-9ae38-serving-cert\""
Jul 30 17:13:12.969677 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.969664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-9ae38-kube-rbac-proxy-sar-config\""
Jul 30 17:13:12.976863 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:12.976835    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"]
Jul 30 17:13:13.049739 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.049702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-openshift-service-ca-bundle\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.049903 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.049745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.150874 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.150841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.151037 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.150902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-openshift-service-ca-bundle\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.151037 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:13:13.150989    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-9ae38-serving-cert: secret "sequence-graph-9ae38-serving-cert" not found
Jul 30 17:13:13.151136 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:13:13.151063    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls podName:2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a nodeName:}" failed. No retries permitted until 2026-07-30 17:13:13.651047748 +0000 UTC m=+753.804290430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls") pod "sequence-graph-9ae38-b9f7f6958-tdphf" (UID: "2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a") : secret "sequence-graph-9ae38-serving-cert" not found
Jul 30 17:13:13.151521 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.151505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-openshift-service-ca-bundle\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.655433 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.655403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.657814 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.657786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls\") pod \"sequence-graph-9ae38-b9f7f6958-tdphf\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") " pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:13.877395 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:13.877363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:14.006887 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:14.006855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"]
Jul 30 17:13:14.009997 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:13:14.009964    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eef1ae0_e22d_4a3d_84ca_20ce5c774b0a.slice/crio-687da4e2f0846c8c4f0fc5be292f823e3c7924bec9a5d48c77107a07cc250cea WatchSource:0}: Error finding container 687da4e2f0846c8c4f0fc5be292f823e3c7924bec9a5d48c77107a07cc250cea: Status 404 returned error can't find the container with id 687da4e2f0846c8c4f0fc5be292f823e3c7924bec9a5d48c77107a07cc250cea
Jul 30 17:13:14.111075 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:14.111033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" event={"ID":"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a","Type":"ContainerStarted","Data":"c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff"}
Jul 30 17:13:14.111250 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:14.111116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" event={"ID":"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a","Type":"ContainerStarted","Data":"687da4e2f0846c8c4f0fc5be292f823e3c7924bec9a5d48c77107a07cc250cea"}
Jul 30 17:13:14.111250 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:14.111168    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:13:14.126673 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:14.126604    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podStartSLOduration=2.126590734 podStartE2EDuration="2.126590734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:13:14.126293618 +0000 UTC m=+754.279536333" watchObservedRunningTime="2026-07-30 17:13:14.126590734 +0000 UTC m=+754.279833436"
Jul 30 17:13:20.120629 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:13:20.120599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:20:31.541868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.541832    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"]
Jul 30 17:20:31.542505 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.542109    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" containerID="cri-o://f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935" gracePeriod=30
Jul 30 17:20:31.686448 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.686418    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"]
Jul 30 17:20:31.686663 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.686632    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" containerID="cri-o://55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc" gracePeriod=30
Jul 30 17:20:31.686799 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.686696    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kube-rbac-proxy" containerID="cri-o://9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2" gracePeriod=30
Jul 30 17:20:31.806705 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.806678    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"]
Jul 30 17:20:31.809822 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.809799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:31.811749 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.811730    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c48ce-kube-rbac-proxy-sar-config\""
Jul 30 17:20:31.811843 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.811788    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c48ce-predictor-serving-cert\""
Jul 30 17:20:31.819504 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.819476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"]
Jul 30 17:20:31.947285 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.947249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-proxy-tls\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:31.947285 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.947284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:31.947497 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:31.947317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg49f\" (UniqueName: \"kubernetes.io/projected/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-api-access-pg49f\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.048419 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.048382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.048419 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.048420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg49f\" (UniqueName: \"kubernetes.io/projected/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-api-access-pg49f\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.048666 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.048482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-proxy-tls\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.049060 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.049037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.051069 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.051049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-proxy-tls\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.059503 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.059448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg49f\" (UniqueName: \"kubernetes.io/projected/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-api-access-pg49f\") pod \"success-200-isvc-c48ce-predictor-6bb7889575-w942q\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") " pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.120365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.120319    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.256219 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.254354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"]
Jul 30 17:20:32.259847 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:20:32.259815    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cb6eca_b5f0_4655_8d78_be9c8d4c2639.slice/crio-7d131d4f2177323658c258af38d1db34e43c4ba684829f8374e37e847663e698 WatchSource:0}: Error finding container 7d131d4f2177323658c258af38d1db34e43c4ba684829f8374e37e847663e698: Status 404 returned error can't find the container with id 7d131d4f2177323658c258af38d1db34e43c4ba684829f8374e37e847663e698
Jul 30 17:20:32.657657 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.657627    2560 generic.go:356] "Generic (PLEG): container finished" podID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerID="9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2" exitCode=2
Jul 30 17:20:32.658050 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.657708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" event={"ID":"85b9dffd-22ca-4623-bab8-4b5e3aede126","Type":"ContainerDied","Data":"9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2"}
Jul 30 17:20:32.659328 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.659309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" event={"ID":"96cb6eca-b5f0-4655-8d78-be9c8d4c2639","Type":"ContainerStarted","Data":"66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a"}
Jul 30 17:20:32.659416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.659349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" event={"ID":"96cb6eca-b5f0-4655-8d78-be9c8d4c2639","Type":"ContainerStarted","Data":"8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3"}
Jul 30 17:20:32.659416 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.659372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" event={"ID":"96cb6eca-b5f0-4655-8d78-be9c8d4c2639","Type":"ContainerStarted","Data":"7d131d4f2177323658c258af38d1db34e43c4ba684829f8374e37e847663e698"}
Jul 30 17:20:32.659491 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.659476    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.659654 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.659628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:32.660923 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.660898    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 30 17:20:32.676317 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:32.676270    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podStartSLOduration=1.6762572759999999 podStartE2EDuration="1.676257276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:20:32.675391767 +0000 UTC m=+1192.828634472" watchObservedRunningTime="2026-07-30 17:20:32.676257276 +0000 UTC m=+1192.829499979"
Jul 30 17:20:33.662884 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:33.662845    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 30 17:20:33.905529 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:33.905492    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:20:34.687346 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:34.687305    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.19:8643/healthz\": dial tcp 10.133.0.19:8643: connect: connection refused"
Jul 30 17:20:34.692036 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:34.692009    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Jul 30 17:20:34.935792 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:34.935766    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:20:35.070829 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.070737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-rbac-proxy-sar-config\") pod \"85b9dffd-22ca-4623-bab8-4b5e3aede126\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") "
Jul 30 17:20:35.070829 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.070781    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppj58\" (UniqueName: \"kubernetes.io/projected/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-api-access-ppj58\") pod \"85b9dffd-22ca-4623-bab8-4b5e3aede126\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") "
Jul 30 17:20:35.071065 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.070850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85b9dffd-22ca-4623-bab8-4b5e3aede126-proxy-tls\") pod \"85b9dffd-22ca-4623-bab8-4b5e3aede126\" (UID: \"85b9dffd-22ca-4623-bab8-4b5e3aede126\") "
Jul 30 17:20:35.071122 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.071071    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "85b9dffd-22ca-4623-bab8-4b5e3aede126" (UID: "85b9dffd-22ca-4623-bab8-4b5e3aede126"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:20:35.073010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.072984    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-api-access-ppj58" (OuterVolumeSpecName: "kube-api-access-ppj58") pod "85b9dffd-22ca-4623-bab8-4b5e3aede126" (UID: "85b9dffd-22ca-4623-bab8-4b5e3aede126"). InnerVolumeSpecName "kube-api-access-ppj58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:20:35.073119 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.073100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b9dffd-22ca-4623-bab8-4b5e3aede126-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "85b9dffd-22ca-4623-bab8-4b5e3aede126" (UID: "85b9dffd-22ca-4623-bab8-4b5e3aede126"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:20:35.171977 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.171936    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85b9dffd-22ca-4623-bab8-4b5e3aede126-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:20:35.171977 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.171971    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:20:35.171977 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.171984    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppj58\" (UniqueName: \"kubernetes.io/projected/85b9dffd-22ca-4623-bab8-4b5e3aede126-kube-api-access-ppj58\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:20:35.670234 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.670205    2560 generic.go:356] "Generic (PLEG): container finished" podID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerID="55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc" exitCode=0
Jul 30 17:20:35.670405 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.670256    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"
Jul 30 17:20:35.670405 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.670284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" event={"ID":"85b9dffd-22ca-4623-bab8-4b5e3aede126","Type":"ContainerDied","Data":"55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc"}
Jul 30 17:20:35.670405 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.670342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx" event={"ID":"85b9dffd-22ca-4623-bab8-4b5e3aede126","Type":"ContainerDied","Data":"8e2ceb3eb24ba1ad8ef4260a06d46fb21e103aa169443b0c9799da4014a5dfdb"}
Jul 30 17:20:35.670405 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.670370    2560 scope.go:117] "RemoveContainer" containerID="9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2"
Jul 30 17:20:35.678637 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.678619    2560 scope.go:117] "RemoveContainer" containerID="55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc"
Jul 30 17:20:35.685975 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.685960    2560 scope.go:117] "RemoveContainer" containerID="9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2"
Jul 30 17:20:35.686246 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:20:35.686215    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2\": container with ID starting with 9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2 not found: ID does not exist" containerID="9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2"
Jul 30 17:20:35.686334 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.686245    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2"} err="failed to get container status \"9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2\": rpc error: code = NotFound desc = could not find container \"9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2\": container with ID starting with 9212b876e76d84910d4e31b6035cdede0f566956ce9db18cdec31b3e033b95a2 not found: ID does not exist"
Jul 30 17:20:35.686334 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.686261    2560 scope.go:117] "RemoveContainer" containerID="55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc"
Jul 30 17:20:35.686491 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:20:35.686474    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc\": container with ID starting with 55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc not found: ID does not exist" containerID="55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc"
Jul 30 17:20:35.686529 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.686501    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc"} err="failed to get container status \"55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc\": rpc error: code = NotFound desc = could not find container \"55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc\": container with ID starting with 55c5481a053459d7172c83d5de085597f444f4a1340b1d01c14cb86f804109cc not found: ID does not exist"
Jul 30 17:20:35.690062 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.690038    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"]
Jul 30 17:20:35.691732 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:35.691712    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8bf5c-predictor-696548fcc7-ntglx"]
Jul 30 17:20:36.390002 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:36.389971    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" path="/var/lib/kubelet/pods/85b9dffd-22ca-4623-bab8-4b5e3aede126/volumes"
Jul 30 17:20:38.667698 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:38.667670    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:20:38.668123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:38.668099    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 30 17:20:38.906383 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:38.906342    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:20:43.905608 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:43.905556    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:20:43.906072 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:43.905690    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:20:48.668423 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:48.668384    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 30 17:20:48.905869 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:48.905830    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:20:53.906402 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:53.906359    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:20:58.668693 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:58.668655    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 30 17:20:58.905914 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:20:58.905869    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:01.689121 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.689094    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:21:01.763574 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.763529    2560 generic.go:356] "Generic (PLEG): container finished" podID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerID="f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935" exitCode=0
Jul 30 17:21:01.763574 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.763577    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"
Jul 30 17:21:01.763769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.763619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" event={"ID":"7a405a1c-b348-4a32-8365-0d931ae4eae7","Type":"ContainerDied","Data":"f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935"}
Jul 30 17:21:01.763769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.763677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7" event={"ID":"7a405a1c-b348-4a32-8365-0d931ae4eae7","Type":"ContainerDied","Data":"2aa4217617ac1ca99c2ea98dfeb93e8a17e4c72c1702ee9d342c53c0f108da87"}
Jul 30 17:21:01.763769 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.763698    2560 scope.go:117] "RemoveContainer" containerID="f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935"
Jul 30 17:21:01.771411 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.771384    2560 scope.go:117] "RemoveContainer" containerID="f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935"
Jul 30 17:21:01.771675 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:01.771657    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935\": container with ID starting with f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935 not found: ID does not exist" containerID="f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935"
Jul 30 17:21:01.771723 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.771686    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935"} err="failed to get container status \"f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935\": rpc error: code = NotFound desc = could not find container \"f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935\": container with ID starting with f2b5942579db0bec28d71a5adda48b597a0389a816d9fe01a943e12cf5231935 not found: ID does not exist"
Jul 30 17:21:01.782967 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.782946    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a405a1c-b348-4a32-8365-0d931ae4eae7-proxy-tls\") pod \"7a405a1c-b348-4a32-8365-0d931ae4eae7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") "
Jul 30 17:21:01.783080 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.782999    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a405a1c-b348-4a32-8365-0d931ae4eae7-openshift-service-ca-bundle\") pod \"7a405a1c-b348-4a32-8365-0d931ae4eae7\" (UID: \"7a405a1c-b348-4a32-8365-0d931ae4eae7\") "
Jul 30 17:21:01.783429 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.783402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a405a1c-b348-4a32-8365-0d931ae4eae7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7a405a1c-b348-4a32-8365-0d931ae4eae7" (UID: "7a405a1c-b348-4a32-8365-0d931ae4eae7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:21:01.785110 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.785089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a405a1c-b348-4a32-8365-0d931ae4eae7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7a405a1c-b348-4a32-8365-0d931ae4eae7" (UID: "7a405a1c-b348-4a32-8365-0d931ae4eae7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:21:01.883703 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.883633    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a405a1c-b348-4a32-8365-0d931ae4eae7-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:01.883703 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:01.883660    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a405a1c-b348-4a32-8365-0d931ae4eae7-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:02.083029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:02.082998    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"]
Jul 30 17:21:02.086951 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:02.086925    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8bf5c-5dd585f497-dvlv7"]
Jul 30 17:21:02.389703 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:02.389669    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" path="/var/lib/kubelet/pods/7a405a1c-b348-4a32-8365-0d931ae4eae7/volumes"
Jul 30 17:21:08.668434 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:08.668389    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 30 17:21:18.669132 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:18.669100    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:21:27.619453 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.619412    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"]
Jul 30 17:21:27.619846 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.619716    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" containerID="cri-o://c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff" gracePeriod=30
Jul 30 17:21:27.729585 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.729553    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"]
Jul 30 17:21:27.729830 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.729791    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container" containerID="cri-o://d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba" gracePeriod=30
Jul 30 17:21:27.729946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.729872    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kube-rbac-proxy" containerID="cri-o://d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a" gracePeriod=30
Jul 30 17:21:27.812415 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812374    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"]
Jul 30 17:21:27.812735 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812718    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container"
Jul 30 17:21:27.812812 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812737    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container"
Jul 30 17:21:27.812812 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812757    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c"
Jul 30 17:21:27.812812 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812766    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c"
Jul 30 17:21:27.812812 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812778    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kube-rbac-proxy"
Jul 30 17:21:27.812812 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812787    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kube-rbac-proxy"
Jul 30 17:21:27.813083 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812867    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kube-rbac-proxy"
Jul 30 17:21:27.813083 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b9dffd-22ca-4623-bab8-4b5e3aede126" containerName="kserve-container"
Jul 30 17:21:27.813083 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.812891    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a405a1c-b348-4a32-8365-0d931ae4eae7" containerName="switch-graph-8bf5c"
Jul 30 17:21:27.815872 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.815850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.818061 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.818039    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0186d-predictor-serving-cert\""
Jul 30 17:21:27.818198 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.818045    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0186d-kube-rbac-proxy-sar-config\""
Jul 30 17:21:27.825615 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.825588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"]
Jul 30 17:21:27.856069 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.856041    2560 generic.go:356] "Generic (PLEG): container finished" podID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerID="d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a" exitCode=2
Jul 30 17:21:27.856256 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.856119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" event={"ID":"256075e0-ab2b-4edd-86f0-c529c460aa1e","Type":"ContainerDied","Data":"d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a"}
Jul 30 17:21:27.893892 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.893821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/693c5522-fe16-4924-9992-d11e90cf6d09-proxy-tls\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.894039 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.893894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9qn\" (UniqueName: \"kubernetes.io/projected/693c5522-fe16-4924-9992-d11e90cf6d09-kube-api-access-qm9qn\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.894039 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.893974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/693c5522-fe16-4924-9992-d11e90cf6d09-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.994498 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.994460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9qn\" (UniqueName: \"kubernetes.io/projected/693c5522-fe16-4924-9992-d11e90cf6d09-kube-api-access-qm9qn\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.994666 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.994507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/693c5522-fe16-4924-9992-d11e90cf6d09-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.994666 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.994536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/693c5522-fe16-4924-9992-d11e90cf6d09-proxy-tls\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.995194 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.995140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/693c5522-fe16-4924-9992-d11e90cf6d09-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:27.997127 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:27.997110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/693c5522-fe16-4924-9992-d11e90cf6d09-proxy-tls\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:28.002896 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.002870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9qn\" (UniqueName: \"kubernetes.io/projected/693c5522-fe16-4924-9992-d11e90cf6d09-kube-api-access-qm9qn\") pod \"success-200-isvc-0186d-predictor-d7f9c495-s9s7t\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") " pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:28.127194 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.127166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:28.257476 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.257455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"]
Jul 30 17:21:28.260142 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:21:28.260118    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693c5522_fe16_4924_9992_d11e90cf6d09.slice/crio-9c9e5be016d503a3d46be6812853b414fe66882baae87ba78b7281b7a84eab10 WatchSource:0}: Error finding container 9c9e5be016d503a3d46be6812853b414fe66882baae87ba78b7281b7a84eab10: Status 404 returned error can't find the container with id 9c9e5be016d503a3d46be6812853b414fe66882baae87ba78b7281b7a84eab10
Jul 30 17:21:28.862963 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.862928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" event={"ID":"693c5522-fe16-4924-9992-d11e90cf6d09","Type":"ContainerStarted","Data":"0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957"}
Jul 30 17:21:28.863382 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.862984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" event={"ID":"693c5522-fe16-4924-9992-d11e90cf6d09","Type":"ContainerStarted","Data":"e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c"}
Jul 30 17:21:28.863382 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.863010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" event={"ID":"693c5522-fe16-4924-9992-d11e90cf6d09","Type":"ContainerStarted","Data":"9c9e5be016d503a3d46be6812853b414fe66882baae87ba78b7281b7a84eab10"}
Jul 30 17:21:28.863382 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.863175    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:28.863382 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.863214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:28.864528 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.864502    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 30 17:21:28.878716 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:28.878670    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podStartSLOduration=1.878655274 podStartE2EDuration="1.878655274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:21:28.87776785 +0000 UTC m=+1249.031010572" watchObservedRunningTime="2026-07-30 17:21:28.878655274 +0000 UTC m=+1249.031897976"
Jul 30 17:21:29.866637 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:29.866599    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 30 17:21:30.118783 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:30.118690    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:31.076517 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.076494    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:21:31.222726 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.222691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-rbac-proxy-sar-config\") pod \"256075e0-ab2b-4edd-86f0-c529c460aa1e\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") "
Jul 30 17:21:31.222908 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.222745    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls\") pod \"256075e0-ab2b-4edd-86f0-c529c460aa1e\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") "
Jul 30 17:21:31.222908 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.222782    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd4tw\" (UniqueName: \"kubernetes.io/projected/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-api-access-bd4tw\") pod \"256075e0-ab2b-4edd-86f0-c529c460aa1e\" (UID: \"256075e0-ab2b-4edd-86f0-c529c460aa1e\") "
Jul 30 17:21:31.223190 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.223129    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "256075e0-ab2b-4edd-86f0-c529c460aa1e" (UID: "256075e0-ab2b-4edd-86f0-c529c460aa1e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:21:31.225127 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.225098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "256075e0-ab2b-4edd-86f0-c529c460aa1e" (UID: "256075e0-ab2b-4edd-86f0-c529c460aa1e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:21:31.225127 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.225102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-api-access-bd4tw" (OuterVolumeSpecName: "kube-api-access-bd4tw") pod "256075e0-ab2b-4edd-86f0-c529c460aa1e" (UID: "256075e0-ab2b-4edd-86f0-c529c460aa1e"). InnerVolumeSpecName "kube-api-access-bd4tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:21:31.323664 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.323631    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd4tw\" (UniqueName: \"kubernetes.io/projected/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-api-access-bd4tw\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:31.323664 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.323660    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/256075e0-ab2b-4edd-86f0-c529c460aa1e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:31.323664 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.323670    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/256075e0-ab2b-4edd-86f0-c529c460aa1e-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:31.787941 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.787906    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"]
Jul 30 17:21:31.788211 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.788198    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container"
Jul 30 17:21:31.788211 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.788212    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container"
Jul 30 17:21:31.788316 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.788234    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kube-rbac-proxy"
Jul 30 17:21:31.788316 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.788240    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kube-rbac-proxy"
Jul 30 17:21:31.788316 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.788293    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kube-rbac-proxy"
Jul 30 17:21:31.788316 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.788300    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerName="kserve-container"
Jul 30 17:21:31.791036 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.791020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:31.797048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.797011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c48ce-serving-cert\""
Jul 30 17:21:31.797468 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.797011    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c48ce-kube-rbac-proxy-sar-config\""
Jul 30 17:21:31.801645 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.801620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"]
Jul 30 17:21:31.874694 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.874656    2560 generic.go:356] "Generic (PLEG): container finished" podID="256075e0-ab2b-4edd-86f0-c529c460aa1e" containerID="d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba" exitCode=0
Jul 30 17:21:31.874694 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.874698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" event={"ID":"256075e0-ab2b-4edd-86f0-c529c460aa1e","Type":"ContainerDied","Data":"d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba"}
Jul 30 17:21:31.874889 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.874729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"
Jul 30 17:21:31.874889 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.874756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl" event={"ID":"256075e0-ab2b-4edd-86f0-c529c460aa1e","Type":"ContainerDied","Data":"f40046838731700e338dd64a410fcf2c8ad688f9764139f58ccbf81935c7e9e6"}
Jul 30 17:21:31.874889 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.874785    2560 scope.go:117] "RemoveContainer" containerID="d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a"
Jul 30 17:21:31.883343 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.883321    2560 scope.go:117] "RemoveContainer" containerID="d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba"
Jul 30 17:21:31.890566 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.890547    2560 scope.go:117] "RemoveContainer" containerID="d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a"
Jul 30 17:21:31.890807 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:31.890786    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a\": container with ID starting with d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a not found: ID does not exist" containerID="d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a"
Jul 30 17:21:31.890849 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.890817    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a"} err="failed to get container status \"d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a\": rpc error: code = NotFound desc = could not find container \"d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a\": container with ID starting with d611663faba8bf4abee5f7dd29c3eb370e700b81348038013d5808671ddb825a not found: ID does not exist"
Jul 30 17:21:31.890849 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.890834    2560 scope.go:117] "RemoveContainer" containerID="d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba"
Jul 30 17:21:31.891062 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:31.891045    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba\": container with ID starting with d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba not found: ID does not exist" containerID="d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba"
Jul 30 17:21:31.891098 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.891069    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba"} err="failed to get container status \"d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba\": rpc error: code = NotFound desc = could not find container \"d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba\": container with ID starting with d843e5e33ae386ee7620128527ab476afdc84b8f9eab77e210f890e9b45fe7ba not found: ID does not exist"
Jul 30 17:21:31.894592 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.894570    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"]
Jul 30 17:21:31.900367 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.900343    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9ae38-predictor-6bc5dbf5cc-v4lsl"]
Jul 30 17:21:31.929836 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.929807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab49929-121b-4ace-8fad-548c99bb4d14-openshift-service-ca-bundle\") pod \"ensemble-graph-c48ce-58c7759bd7-p4qxv\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") " pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:31.929985 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:31.929853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eab49929-121b-4ace-8fad-548c99bb4d14-proxy-tls\") pod \"ensemble-graph-c48ce-58c7759bd7-p4qxv\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") " pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.030755 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.030724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab49929-121b-4ace-8fad-548c99bb4d14-openshift-service-ca-bundle\") pod \"ensemble-graph-c48ce-58c7759bd7-p4qxv\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") " pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.030924 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.030769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eab49929-121b-4ace-8fad-548c99bb4d14-proxy-tls\") pod \"ensemble-graph-c48ce-58c7759bd7-p4qxv\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") " pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.031422 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.031400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab49929-121b-4ace-8fad-548c99bb4d14-openshift-service-ca-bundle\") pod \"ensemble-graph-c48ce-58c7759bd7-p4qxv\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") " pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.033295 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.033274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eab49929-121b-4ace-8fad-548c99bb4d14-proxy-tls\") pod \"ensemble-graph-c48ce-58c7759bd7-p4qxv\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") " pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.107084 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.106983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.243850 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.243816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"]
Jul 30 17:21:32.246564 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:21:32.246539    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab49929_121b_4ace_8fad_548c99bb4d14.slice/crio-a32d28413c95894d5da112779e10e193eea8b5380bcac56e3bfd22e30aedd904 WatchSource:0}: Error finding container a32d28413c95894d5da112779e10e193eea8b5380bcac56e3bfd22e30aedd904: Status 404 returned error can't find the container with id a32d28413c95894d5da112779e10e193eea8b5380bcac56e3bfd22e30aedd904
Jul 30 17:21:32.390781 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.390699    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256075e0-ab2b-4edd-86f0-c529c460aa1e" path="/var/lib/kubelet/pods/256075e0-ab2b-4edd-86f0-c529c460aa1e/volumes"
Jul 30 17:21:32.880400 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.880362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" event={"ID":"eab49929-121b-4ace-8fad-548c99bb4d14","Type":"ContainerStarted","Data":"4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd"}
Jul 30 17:21:32.880619 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.880426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" event={"ID":"eab49929-121b-4ace-8fad-548c99bb4d14","Type":"ContainerStarted","Data":"a32d28413c95894d5da112779e10e193eea8b5380bcac56e3bfd22e30aedd904"}
Jul 30 17:21:32.880619 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.880459    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:32.895198 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:32.895128    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podStartSLOduration=1.8951102469999999 podStartE2EDuration="1.895110247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:21:32.893665237 +0000 UTC m=+1253.046907958" watchObservedRunningTime="2026-07-30 17:21:32.895110247 +0000 UTC m=+1253.048352949"
Jul 30 17:21:34.871334 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:34.871308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:21:34.871750 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:34.871724    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 30 17:21:35.119111 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:35.119068    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:38.890266 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:38.890238    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:40.118680 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:40.118641    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:40.119144 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:40.118743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:21:41.882866 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:41.882790    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"]
Jul 30 17:21:41.883330 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:41.882961    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" containerID="cri-o://4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd" gracePeriod=30
Jul 30 17:21:41.987029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:41.986994    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"]
Jul 30 17:21:41.987376 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:41.987345    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kube-rbac-proxy" containerID="cri-o://66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a" gracePeriod=30
Jul 30 17:21:41.987376 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:41.987338    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container" containerID="cri-o://8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3" gracePeriod=30
Jul 30 17:21:42.052889 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.052854    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"]
Jul 30 17:21:42.057479 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.057458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.059669 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.059647    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-ba640-predictor-serving-cert\""
Jul 30 17:21:42.059669 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.059658    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-ba640-kube-rbac-proxy-sar-config\""
Jul 30 17:21:42.067047 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.067015    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"]
Jul 30 17:21:42.210672 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.210624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.210858 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.210757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.210858 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.210797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9f8w\" (UniqueName: \"kubernetes.io/projected/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-api-access-d9f8w\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.311667 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.311624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.311667 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.311668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9f8w\" (UniqueName: \"kubernetes.io/projected/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-api-access-d9f8w\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.311887 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.311707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.311887 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:42.311778    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-ba640-predictor-serving-cert: secret "success-200-isvc-ba640-predictor-serving-cert" not found
Jul 30 17:21:42.311887 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:42.311846    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls podName:9b1fc519-8c47-41d3-9475-2cd48e10296d nodeName:}" failed. No retries permitted until 2026-07-30 17:21:42.811830221 +0000 UTC m=+1262.965072901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls") pod "success-200-isvc-ba640-predictor-578f66447f-xk7vm" (UID: "9b1fc519-8c47-41d3-9475-2cd48e10296d") : secret "success-200-isvc-ba640-predictor-serving-cert" not found
Jul 30 17:21:42.312381 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.312362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.319961 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.319934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9f8w\" (UniqueName: \"kubernetes.io/projected/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-api-access-d9f8w\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.816004 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.815961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.818601 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.818568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls\") pod \"success-200-isvc-ba640-predictor-578f66447f-xk7vm\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") " pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:42.918724 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.918688    2560 generic.go:356] "Generic (PLEG): container finished" podID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerID="66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a" exitCode=2
Jul 30 17:21:42.919082 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.918761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" event={"ID":"96cb6eca-b5f0-4655-8d78-be9c8d4c2639","Type":"ContainerDied","Data":"66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a"}
Jul 30 17:21:42.968109 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:42.968065    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:43.101871 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.101714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"]
Jul 30 17:21:43.104439 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:21:43.104412    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1fc519_8c47_41d3_9475_2cd48e10296d.slice/crio-d37b4413265e82f265ac2f5463948128096c2aac9a742888edbf2ef5e57583ff WatchSource:0}: Error finding container d37b4413265e82f265ac2f5463948128096c2aac9a742888edbf2ef5e57583ff: Status 404 returned error can't find the container with id d37b4413265e82f265ac2f5463948128096c2aac9a742888edbf2ef5e57583ff
Jul 30 17:21:43.663603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.663558    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused"
Jul 30 17:21:43.889605 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.889565    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:43.924483 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.924399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" event={"ID":"9b1fc519-8c47-41d3-9475-2cd48e10296d","Type":"ContainerStarted","Data":"1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06"}
Jul 30 17:21:43.924483 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.924467    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" event={"ID":"9b1fc519-8c47-41d3-9475-2cd48e10296d","Type":"ContainerStarted","Data":"f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027"}
Jul 30 17:21:43.924920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.924505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:43.924920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.924532    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" event={"ID":"9b1fc519-8c47-41d3-9475-2cd48e10296d","Type":"ContainerStarted","Data":"d37b4413265e82f265ac2f5463948128096c2aac9a742888edbf2ef5e57583ff"}
Jul 30 17:21:43.924920 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.924557    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:43.925799 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.925773    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:21:43.943102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:43.943039    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podStartSLOduration=1.9430164699999999 podStartE2EDuration="1.94301647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:21:43.942142635 +0000 UTC m=+1264.095385351" watchObservedRunningTime="2026-07-30 17:21:43.94301647 +0000 UTC m=+1264.096259176"
Jul 30 17:21:44.872731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:44.872692    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 30 17:21:44.928600 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:44.928563    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:21:45.118768 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.118732    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:45.528349 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.528327    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:21:45.537817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.537771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg49f\" (UniqueName: \"kubernetes.io/projected/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-api-access-pg49f\") pod \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") "
Jul 30 17:21:45.537946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.537848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-proxy-tls\") pod \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") "
Jul 30 17:21:45.537946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.537935    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-rbac-proxy-sar-config\") pod \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\" (UID: \"96cb6eca-b5f0-4655-8d78-be9c8d4c2639\") "
Jul 30 17:21:45.538335 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.538305    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "96cb6eca-b5f0-4655-8d78-be9c8d4c2639" (UID: "96cb6eca-b5f0-4655-8d78-be9c8d4c2639"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:21:45.540080 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.540051    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-api-access-pg49f" (OuterVolumeSpecName: "kube-api-access-pg49f") pod "96cb6eca-b5f0-4655-8d78-be9c8d4c2639" (UID: "96cb6eca-b5f0-4655-8d78-be9c8d4c2639"). InnerVolumeSpecName "kube-api-access-pg49f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:21:45.540205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.540094    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "96cb6eca-b5f0-4655-8d78-be9c8d4c2639" (UID: "96cb6eca-b5f0-4655-8d78-be9c8d4c2639"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:21:45.638817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.638735    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:45.638817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.638765    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg49f\" (UniqueName: \"kubernetes.io/projected/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-kube-api-access-pg49f\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:45.638817 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.638779    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/96cb6eca-b5f0-4655-8d78-be9c8d4c2639-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:45.933689 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.933637    2560 generic.go:356] "Generic (PLEG): container finished" podID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerID="8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3" exitCode=0
Jul 30 17:21:45.934102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.933711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" event={"ID":"96cb6eca-b5f0-4655-8d78-be9c8d4c2639","Type":"ContainerDied","Data":"8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3"}
Jul 30 17:21:45.934102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.933757    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"
Jul 30 17:21:45.934102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.933774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q" event={"ID":"96cb6eca-b5f0-4655-8d78-be9c8d4c2639","Type":"ContainerDied","Data":"7d131d4f2177323658c258af38d1db34e43c4ba684829f8374e37e847663e698"}
Jul 30 17:21:45.934102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.933814    2560 scope.go:117] "RemoveContainer" containerID="66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a"
Jul 30 17:21:45.943166 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.943125    2560 scope.go:117] "RemoveContainer" containerID="8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3"
Jul 30 17:21:45.950783 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.950763    2560 scope.go:117] "RemoveContainer" containerID="66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a"
Jul 30 17:21:45.951074 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:45.951046    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a\": container with ID starting with 66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a not found: ID does not exist" containerID="66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a"
Jul 30 17:21:45.951135 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.951076    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a"} err="failed to get container status \"66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a\": rpc error: code = NotFound desc = could not find container \"66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a\": container with ID starting with 66dec86de379465be07a3a09e5298c5320f08ef8cad2823a5d3316843f487f2a not found: ID does not exist"
Jul 30 17:21:45.951135 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.951094    2560 scope.go:117] "RemoveContainer" containerID="8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3"
Jul 30 17:21:45.951318 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:45.951301    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3\": container with ID starting with 8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3 not found: ID does not exist" containerID="8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3"
Jul 30 17:21:45.951358 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.951324    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3"} err="failed to get container status \"8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3\": rpc error: code = NotFound desc = could not find container \"8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3\": container with ID starting with 8b0766d740738399f477cf4c4e68a5fa8d14ce9a2454d8043224de141e5f61f3 not found: ID does not exist"
Jul 30 17:21:45.955536 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.955516    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"]
Jul 30 17:21:45.959662 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:45.959641    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c48ce-predictor-6bb7889575-w942q"]
Jul 30 17:21:46.390205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:46.390097    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" path="/var/lib/kubelet/pods/96cb6eca-b5f0-4655-8d78-be9c8d4c2639/volumes"
Jul 30 17:21:48.889470 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:48.889423    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:49.933353 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:49.933322    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:21:49.933758 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:49.933733    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:21:50.118221 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:50.118185    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:53.890044 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:53.890008    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:53.890436 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:53.890116    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:21:54.872172 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:54.872114    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 30 17:21:55.118888 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:55.118849    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:57.765616 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.765591    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:21:57.831482 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.831450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls\") pod \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") "
Jul 30 17:21:57.831656 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.831516    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-openshift-service-ca-bundle\") pod \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\" (UID: \"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a\") "
Jul 30 17:21:57.831891 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.831859    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" (UID: "2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:21:57.833709 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.833682    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" (UID: "2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:21:57.932268 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.932231    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:57.932268 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.932264    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:21:57.979135 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.979103    2560 generic.go:356] "Generic (PLEG): container finished" podID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerID="c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff" exitCode=0
Jul 30 17:21:57.979296 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.979144    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"
Jul 30 17:21:57.979296 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.979181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" event={"ID":"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a","Type":"ContainerDied","Data":"c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff"}
Jul 30 17:21:57.979296 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.979228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf" event={"ID":"2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a","Type":"ContainerDied","Data":"687da4e2f0846c8c4f0fc5be292f823e3c7924bec9a5d48c77107a07cc250cea"}
Jul 30 17:21:57.979296 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.979250    2560 scope.go:117] "RemoveContainer" containerID="c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff"
Jul 30 17:21:57.987839 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.987822    2560 scope.go:117] "RemoveContainer" containerID="c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff"
Jul 30 17:21:57.988100 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:21:57.988081    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff\": container with ID starting with c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff not found: ID does not exist" containerID="c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff"
Jul 30 17:21:57.988160 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.988109    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff"} err="failed to get container status \"c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff\": rpc error: code = NotFound desc = could not find container \"c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff\": container with ID starting with c8d01cc796df801a90921795e01c2e56c451b9ccdfb49b02ec0b1d096ef78dff not found: ID does not exist"
Jul 30 17:21:57.998227 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.998197    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"]
Jul 30 17:21:57.999659 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:57.999642    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9ae38-b9f7f6958-tdphf"]
Jul 30 17:21:58.390177 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:58.390083    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" path="/var/lib/kubelet/pods/2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a/volumes"
Jul 30 17:21:58.889926 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:58.889886    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:21:59.934255 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:21:59.934211    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:22:03.889250 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:03.889209    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:22:04.872637 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:04.872596    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 30 17:22:08.889736 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:08.889698    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:22:09.933735 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:09.933696    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:22:12.026167 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.026127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:22:12.028802 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.028762    2560 generic.go:356] "Generic (PLEG): container finished" podID="eab49929-121b-4ace-8fad-548c99bb4d14" containerID="4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd" exitCode=0
Jul 30 17:22:12.028929 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.028826    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"
Jul 30 17:22:12.028929 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.028830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" event={"ID":"eab49929-121b-4ace-8fad-548c99bb4d14","Type":"ContainerDied","Data":"4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd"}
Jul 30 17:22:12.028929 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.028892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv" event={"ID":"eab49929-121b-4ace-8fad-548c99bb4d14","Type":"ContainerDied","Data":"a32d28413c95894d5da112779e10e193eea8b5380bcac56e3bfd22e30aedd904"}
Jul 30 17:22:12.028929 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.028915    2560 scope.go:117] "RemoveContainer" containerID="4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd"
Jul 30 17:22:12.036478 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.036459    2560 scope.go:117] "RemoveContainer" containerID="4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd"
Jul 30 17:22:12.036811 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:22:12.036791    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd\": container with ID starting with 4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd not found: ID does not exist" containerID="4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd"
Jul 30 17:22:12.036893 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.036821    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd"} err="failed to get container status \"4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd\": rpc error: code = NotFound desc = could not find container \"4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd\": container with ID starting with 4e22acf847c4ba74d3ba3c3d7bc9ff529b7a527da09bbba600849c81e90d4ffd not found: ID does not exist"
Jul 30 17:22:12.138180 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.138078    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab49929-121b-4ace-8fad-548c99bb4d14-openshift-service-ca-bundle\") pod \"eab49929-121b-4ace-8fad-548c99bb4d14\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") "
Jul 30 17:22:12.138180 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.138169    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eab49929-121b-4ace-8fad-548c99bb4d14-proxy-tls\") pod \"eab49929-121b-4ace-8fad-548c99bb4d14\" (UID: \"eab49929-121b-4ace-8fad-548c99bb4d14\") "
Jul 30 17:22:12.138557 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.138529    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab49929-121b-4ace-8fad-548c99bb4d14-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "eab49929-121b-4ace-8fad-548c99bb4d14" (UID: "eab49929-121b-4ace-8fad-548c99bb4d14"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:22:12.140533 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.140494    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab49929-121b-4ace-8fad-548c99bb4d14-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "eab49929-121b-4ace-8fad-548c99bb4d14" (UID: "eab49929-121b-4ace-8fad-548c99bb4d14"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:22:12.239588 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.239551    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab49929-121b-4ace-8fad-548c99bb4d14-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:22:12.239588 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.239580    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eab49929-121b-4ace-8fad-548c99bb4d14-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:22:12.348821 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.348789    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"]
Jul 30 17:22:12.352748 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.352721    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c48ce-58c7759bd7-p4qxv"]
Jul 30 17:22:12.390477 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:12.390390    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" path="/var/lib/kubelet/pods/eab49929-121b-4ace-8fad-548c99bb4d14/volumes"
Jul 30 17:22:14.872313 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:14.872285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:22:19.933930 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:19.933890    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:22:27.849578 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849547    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"]
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849835    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849846    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849859    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849865    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849871    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kube-rbac-proxy"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849879    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kube-rbac-proxy"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849889    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849961    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kserve-container"
Jul 30 17:22:27.849964 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849968    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="96cb6eca-b5f0-4655-8d78-be9c8d4c2639" containerName="kube-rbac-proxy"
Jul 30 17:22:27.850300 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849979    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab49929-121b-4ace-8fad-548c99bb4d14" containerName="ensemble-graph-c48ce"
Jul 30 17:22:27.850300 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.849989    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eef1ae0-e22d-4a3d-84ca-20ce5c774b0a" containerName="sequence-graph-9ae38"
Jul 30 17:22:27.853855 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.853837    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:27.856373 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.856349    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-0186d-kube-rbac-proxy-sar-config\""
Jul 30 17:22:27.856373 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.856354    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-0186d-serving-cert\""
Jul 30 17:22:27.865363 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.865339    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"]
Jul 30 17:22:27.963307 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.963272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825f7864-1e71-4a32-9149-4fbcc2eaf13b-openshift-service-ca-bundle\") pod \"sequence-graph-0186d-5d68f947c5-4sxgl\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") " pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:27.963492 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:27.963392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/825f7864-1e71-4a32-9149-4fbcc2eaf13b-proxy-tls\") pod \"sequence-graph-0186d-5d68f947c5-4sxgl\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") " pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:28.064731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:28.064691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825f7864-1e71-4a32-9149-4fbcc2eaf13b-openshift-service-ca-bundle\") pod \"sequence-graph-0186d-5d68f947c5-4sxgl\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") " pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:28.064939 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:28.064777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/825f7864-1e71-4a32-9149-4fbcc2eaf13b-proxy-tls\") pod \"sequence-graph-0186d-5d68f947c5-4sxgl\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") " pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:28.065387 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:28.065353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825f7864-1e71-4a32-9149-4fbcc2eaf13b-openshift-service-ca-bundle\") pod \"sequence-graph-0186d-5d68f947c5-4sxgl\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") " pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:28.067420 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:28.067399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/825f7864-1e71-4a32-9149-4fbcc2eaf13b-proxy-tls\") pod \"sequence-graph-0186d-5d68f947c5-4sxgl\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") " pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:28.163010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:28.162982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:28.291439 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:28.291401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"]
Jul 30 17:22:28.294115 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:22:28.294088    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825f7864_1e71_4a32_9149_4fbcc2eaf13b.slice/crio-1f79237da1040eb3cef178f626446234cc9124fedc2f0ea9dc5a8c8dd9ccb1ef WatchSource:0}: Error finding container 1f79237da1040eb3cef178f626446234cc9124fedc2f0ea9dc5a8c8dd9ccb1ef: Status 404 returned error can't find the container with id 1f79237da1040eb3cef178f626446234cc9124fedc2f0ea9dc5a8c8dd9ccb1ef
Jul 30 17:22:29.091082 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:29.091044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" event={"ID":"825f7864-1e71-4a32-9149-4fbcc2eaf13b","Type":"ContainerStarted","Data":"796213633f88055bc4f14254be31bb4a9119c908ff9be26d9f966974c28bff0a"}
Jul 30 17:22:29.091511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:29.091106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" event={"ID":"825f7864-1e71-4a32-9149-4fbcc2eaf13b","Type":"ContainerStarted","Data":"1f79237da1040eb3cef178f626446234cc9124fedc2f0ea9dc5a8c8dd9ccb1ef"}
Jul 30 17:22:29.091511 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:29.091187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:29.106345 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:29.106293    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podStartSLOduration=2.10627419 podStartE2EDuration="2.10627419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:22:29.105368341 +0000 UTC m=+1309.258611048" watchObservedRunningTime="2026-07-30 17:22:29.10627419 +0000 UTC m=+1309.259516935"
Jul 30 17:22:29.935298 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:29.935269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:22:35.100288 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:35.100255    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:37.924913 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:37.924876    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"]
Jul 30 17:22:37.927403 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:37.925164    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" containerID="cri-o://796213633f88055bc4f14254be31bb4a9119c908ff9be26d9f966974c28bff0a" gracePeriod=30
Jul 30 17:22:38.033488 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.033448    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"]
Jul 30 17:22:38.033741 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.033716    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container" containerID="cri-o://e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c" gracePeriod=30
Jul 30 17:22:38.033840 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.033803    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kube-rbac-proxy" containerID="cri-o://0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957" gracePeriod=30
Jul 30 17:22:38.116524 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.116488    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"]
Jul 30 17:22:38.119534 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.119515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.121690 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.121670    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2393a-predictor-serving-cert\""
Jul 30 17:22:38.121886 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.121862    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2393a-kube-rbac-proxy-sar-config\""
Jul 30 17:22:38.130109 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.130085    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"]
Jul 30 17:22:38.246845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.246750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snhrr\" (UniqueName: \"kubernetes.io/projected/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-api-access-snhrr\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.246845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.246791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.246845 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.246840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-proxy-tls\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.347564 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.347525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.347564 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.347569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-proxy-tls\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.347797 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.347610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snhrr\" (UniqueName: \"kubernetes.io/projected/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-api-access-snhrr\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.348334 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.348313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.350277 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.350259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-proxy-tls\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.354813 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.354788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snhrr\" (UniqueName: \"kubernetes.io/projected/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-api-access-snhrr\") pod \"success-200-isvc-2393a-predictor-7465876489-6ckc4\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") " pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.430301 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.430274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:38.558602 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:38.558577    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"]
Jul 30 17:22:38.561056 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:22:38.561029    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9768ae9_d9f7_4161_bb4c_bfe7f4a2f066.slice/crio-404333c80826708c964d68f34391b775a58114dcbd5a817ccb667452e45cb5e0 WatchSource:0}: Error finding container 404333c80826708c964d68f34391b775a58114dcbd5a817ccb667452e45cb5e0: Status 404 returned error can't find the container with id 404333c80826708c964d68f34391b775a58114dcbd5a817ccb667452e45cb5e0
Jul 30 17:22:39.130635 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.130603    2560 generic.go:356] "Generic (PLEG): container finished" podID="693c5522-fe16-4924-9992-d11e90cf6d09" containerID="0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957" exitCode=2
Jul 30 17:22:39.131048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.130677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" event={"ID":"693c5522-fe16-4924-9992-d11e90cf6d09","Type":"ContainerDied","Data":"0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957"}
Jul 30 17:22:39.132365 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.132337    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" event={"ID":"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066","Type":"ContainerStarted","Data":"86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce"}
Jul 30 17:22:39.132496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.132387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" event={"ID":"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066","Type":"ContainerStarted","Data":"068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da"}
Jul 30 17:22:39.132496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.132412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" event={"ID":"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066","Type":"ContainerStarted","Data":"404333c80826708c964d68f34391b775a58114dcbd5a817ccb667452e45cb5e0"}
Jul 30 17:22:39.132597 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.132531    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:39.149616 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.149563    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podStartSLOduration=1.149546642 podStartE2EDuration="1.149546642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:22:39.147945501 +0000 UTC m=+1319.301188215" watchObservedRunningTime="2026-07-30 17:22:39.149546642 +0000 UTC m=+1319.302789344"
Jul 30 17:22:39.867703 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:39.867660    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused"
Jul 30 17:22:40.098377 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:40.098340    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:22:40.137533 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:40.137449    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:40.139117 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:40.139087    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:22:41.142299 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.142267    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:22:41.378324 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.378304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:22:41.473566 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.473534    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/693c5522-fe16-4924-9992-d11e90cf6d09-kube-rbac-proxy-sar-config\") pod \"693c5522-fe16-4924-9992-d11e90cf6d09\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") "
Jul 30 17:22:41.473731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.473576    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/693c5522-fe16-4924-9992-d11e90cf6d09-proxy-tls\") pod \"693c5522-fe16-4924-9992-d11e90cf6d09\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") "
Jul 30 17:22:41.473731 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.473611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm9qn\" (UniqueName: \"kubernetes.io/projected/693c5522-fe16-4924-9992-d11e90cf6d09-kube-api-access-qm9qn\") pod \"693c5522-fe16-4924-9992-d11e90cf6d09\" (UID: \"693c5522-fe16-4924-9992-d11e90cf6d09\") "
Jul 30 17:22:41.473984 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.473958    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693c5522-fe16-4924-9992-d11e90cf6d09-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "693c5522-fe16-4924-9992-d11e90cf6d09" (UID: "693c5522-fe16-4924-9992-d11e90cf6d09"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:22:41.475864 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.475840    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693c5522-fe16-4924-9992-d11e90cf6d09-kube-api-access-qm9qn" (OuterVolumeSpecName: "kube-api-access-qm9qn") pod "693c5522-fe16-4924-9992-d11e90cf6d09" (UID: "693c5522-fe16-4924-9992-d11e90cf6d09"). InnerVolumeSpecName "kube-api-access-qm9qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:22:41.475969 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.475870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/693c5522-fe16-4924-9992-d11e90cf6d09-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "693c5522-fe16-4924-9992-d11e90cf6d09" (UID: "693c5522-fe16-4924-9992-d11e90cf6d09"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:22:41.575142 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.575111    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/693c5522-fe16-4924-9992-d11e90cf6d09-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:22:41.575142 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.575140    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/693c5522-fe16-4924-9992-d11e90cf6d09-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:22:41.575403 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:41.575171    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm9qn\" (UniqueName: \"kubernetes.io/projected/693c5522-fe16-4924-9992-d11e90cf6d09-kube-api-access-qm9qn\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:22:42.104112 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104071    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"]
Jul 30 17:22:42.104479 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104456    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kube-rbac-proxy"
Jul 30 17:22:42.104479 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104479    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kube-rbac-proxy"
Jul 30 17:22:42.104624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104501    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container"
Jul 30 17:22:42.104624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container"
Jul 30 17:22:42.104624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104586    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kube-rbac-proxy"
Jul 30 17:22:42.104624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.104602    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" containerName="kserve-container"
Jul 30 17:22:42.107544 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.107524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.109784 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.109755    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-ba640-serving-cert\""
Jul 30 17:22:42.109784 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.109777    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-ba640-kube-rbac-proxy-sar-config\""
Jul 30 17:22:42.115743 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.115720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"]
Jul 30 17:22:42.147449 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.147416    2560 generic.go:356] "Generic (PLEG): container finished" podID="693c5522-fe16-4924-9992-d11e90cf6d09" containerID="e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c" exitCode=0
Jul 30 17:22:42.147899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.147466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" event={"ID":"693c5522-fe16-4924-9992-d11e90cf6d09","Type":"ContainerDied","Data":"e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c"}
Jul 30 17:22:42.147899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.147474    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"
Jul 30 17:22:42.147899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.147514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t" event={"ID":"693c5522-fe16-4924-9992-d11e90cf6d09","Type":"ContainerDied","Data":"9c9e5be016d503a3d46be6812853b414fe66882baae87ba78b7281b7a84eab10"}
Jul 30 17:22:42.147899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.147541    2560 scope.go:117] "RemoveContainer" containerID="0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957"
Jul 30 17:22:42.156071 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.156052    2560 scope.go:117] "RemoveContainer" containerID="e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c"
Jul 30 17:22:42.163673 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.163654    2560 scope.go:117] "RemoveContainer" containerID="0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957"
Jul 30 17:22:42.163971 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:22:42.163952    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957\": container with ID starting with 0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957 not found: ID does not exist" containerID="0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957"
Jul 30 17:22:42.164019 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.163982    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957"} err="failed to get container status \"0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957\": rpc error: code = NotFound desc = could not find container \"0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957\": container with ID starting with 0868dd32a4e1d636e23d33e249cd6b4afe30b0faf8ec61580011051c46df0957 not found: ID does not exist"
Jul 30 17:22:42.164019 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.164000    2560 scope.go:117] "RemoveContainer" containerID="e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c"
Jul 30 17:22:42.164280 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:22:42.164263    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c\": container with ID starting with e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c not found: ID does not exist" containerID="e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c"
Jul 30 17:22:42.164340 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.164283    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c"} err="failed to get container status \"e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c\": rpc error: code = NotFound desc = could not find container \"e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c\": container with ID starting with e40304e8fa2a11684c0f77ccd8906af1358f3dd6f981e1a13d39cd05559dc19c not found: ID does not exist"
Jul 30 17:22:42.167457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.167436    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"]
Jul 30 17:22:42.173030 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.173007    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0186d-predictor-d7f9c495-s9s7t"]
Jul 30 17:22:42.281614 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.281572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-openshift-service-ca-bundle\") pod \"ensemble-graph-ba640-6649dcf585-g8z82\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") " pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.281775 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.281634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-proxy-tls\") pod \"ensemble-graph-ba640-6649dcf585-g8z82\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") " pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.382580 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.382488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-openshift-service-ca-bundle\") pod \"ensemble-graph-ba640-6649dcf585-g8z82\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") " pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.382580 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.382541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-proxy-tls\") pod \"ensemble-graph-ba640-6649dcf585-g8z82\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") " pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.383170 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.383122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-openshift-service-ca-bundle\") pod \"ensemble-graph-ba640-6649dcf585-g8z82\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") " pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.385049 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.385022    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-proxy-tls\") pod \"ensemble-graph-ba640-6649dcf585-g8z82\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") " pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.389725 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.389702    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693c5522-fe16-4924-9992-d11e90cf6d09" path="/var/lib/kubelet/pods/693c5522-fe16-4924-9992-d11e90cf6d09/volumes"
Jul 30 17:22:42.418126 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.418092    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:42.548058 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:42.547976    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"]
Jul 30 17:22:42.550692 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:22:42.550668    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48de9f00_6ce3_4202_b0c8_fcc90dd4d413.slice/crio-e5ee378678df64effca25bd2d525da8b05fa6571b0431a2dbeccfc74cae40ccf WatchSource:0}: Error finding container e5ee378678df64effca25bd2d525da8b05fa6571b0431a2dbeccfc74cae40ccf: Status 404 returned error can't find the container with id e5ee378678df64effca25bd2d525da8b05fa6571b0431a2dbeccfc74cae40ccf
Jul 30 17:22:43.152963 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:43.152919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" event={"ID":"48de9f00-6ce3-4202-b0c8-fcc90dd4d413","Type":"ContainerStarted","Data":"a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52"}
Jul 30 17:22:43.153671 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:43.152985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" event={"ID":"48de9f00-6ce3-4202-b0c8-fcc90dd4d413","Type":"ContainerStarted","Data":"e5ee378678df64effca25bd2d525da8b05fa6571b0431a2dbeccfc74cae40ccf"}
Jul 30 17:22:43.153671 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:43.153015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:43.168525 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:43.168478    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podStartSLOduration=1.168462952 podStartE2EDuration="1.168462952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:22:43.166970294 +0000 UTC m=+1323.320212998" watchObservedRunningTime="2026-07-30 17:22:43.168462952 +0000 UTC m=+1323.321705675"
Jul 30 17:22:45.103719 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:45.103673    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:22:46.147652 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:46.147624    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:22:46.148166 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:46.148124    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:22:49.166586 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:49.166555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:22:50.098321 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:50.098284    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:22:50.098497 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:50.098401    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:22:55.098434 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:55.098393    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:22:56.149000 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:22:56.148958    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:23:00.098928 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:00.098887    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:23:05.099214 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:05.099119    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:23:06.148550 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:06.148511    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:23:08.245916 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.245831    2560 generic.go:356] "Generic (PLEG): container finished" podID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerID="796213633f88055bc4f14254be31bb4a9119c908ff9be26d9f966974c28bff0a" exitCode=0
Jul 30 17:23:08.245916 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.245893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" event={"ID":"825f7864-1e71-4a32-9149-4fbcc2eaf13b","Type":"ContainerDied","Data":"796213633f88055bc4f14254be31bb4a9119c908ff9be26d9f966974c28bff0a"}
Jul 30 17:23:08.576491 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.576465    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:23:08.656537 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.656507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825f7864-1e71-4a32-9149-4fbcc2eaf13b-openshift-service-ca-bundle\") pod \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") "
Jul 30 17:23:08.656883 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.656859    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825f7864-1e71-4a32-9149-4fbcc2eaf13b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "825f7864-1e71-4a32-9149-4fbcc2eaf13b" (UID: "825f7864-1e71-4a32-9149-4fbcc2eaf13b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:23:08.756893 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.756858    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/825f7864-1e71-4a32-9149-4fbcc2eaf13b-proxy-tls\") pod \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\" (UID: \"825f7864-1e71-4a32-9149-4fbcc2eaf13b\") "
Jul 30 17:23:08.757051 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.756987    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825f7864-1e71-4a32-9149-4fbcc2eaf13b-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:23:08.759062 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.759037    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825f7864-1e71-4a32-9149-4fbcc2eaf13b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "825f7864-1e71-4a32-9149-4fbcc2eaf13b" (UID: "825f7864-1e71-4a32-9149-4fbcc2eaf13b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:23:08.857575 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:08.857486    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/825f7864-1e71-4a32-9149-4fbcc2eaf13b-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:23:09.250266 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:09.250234    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"
Jul 30 17:23:09.250266 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:09.250248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl" event={"ID":"825f7864-1e71-4a32-9149-4fbcc2eaf13b","Type":"ContainerDied","Data":"1f79237da1040eb3cef178f626446234cc9124fedc2f0ea9dc5a8c8dd9ccb1ef"}
Jul 30 17:23:09.250733 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:09.250316    2560 scope.go:117] "RemoveContainer" containerID="796213633f88055bc4f14254be31bb4a9119c908ff9be26d9f966974c28bff0a"
Jul 30 17:23:09.270070 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:09.270043    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"]
Jul 30 17:23:09.274225 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:09.274203    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0186d-5d68f947c5-4sxgl"]
Jul 30 17:23:10.390763 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:10.390728    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" path="/var/lib/kubelet/pods/825f7864-1e71-4a32-9149-4fbcc2eaf13b/volumes"
Jul 30 17:23:16.148554 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:16.148517    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:23:26.149311 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:26.149282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:23:38.175116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.175082    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"]
Jul 30 17:23:38.175545 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.175380    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d"
Jul 30 17:23:38.175545 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.175390    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d"
Jul 30 17:23:38.175545 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.175443    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="825f7864-1e71-4a32-9149-4fbcc2eaf13b" containerName="sequence-graph-0186d"
Jul 30 17:23:38.177972 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.177954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.179977 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.179951    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-2393a-kube-rbac-proxy-sar-config\""
Jul 30 17:23:38.180087 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.180037    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-2393a-serving-cert\""
Jul 30 17:23:38.186956 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.186933    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"]
Jul 30 17:23:38.248483 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.248443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff070ed3-2934-43cb-acd4-a119a03d65b7-openshift-service-ca-bundle\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.248679 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.248505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.349439 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.349405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.349575 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.349465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff070ed3-2934-43cb-acd4-a119a03d65b7-openshift-service-ca-bundle\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.349575 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:23:38.349561    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-2393a-serving-cert: secret "sequence-graph-2393a-serving-cert" not found
Jul 30 17:23:38.349647 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:23:38.349627    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls podName:ff070ed3-2934-43cb-acd4-a119a03d65b7 nodeName:}" failed. No retries permitted until 2026-07-30 17:23:38.849610539 +0000 UTC m=+1379.002853220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls") pod "sequence-graph-2393a-788d99c97f-2pw96" (UID: "ff070ed3-2934-43cb-acd4-a119a03d65b7") : secret "sequence-graph-2393a-serving-cert" not found
Jul 30 17:23:38.350048 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.350031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff070ed3-2934-43cb-acd4-a119a03d65b7-openshift-service-ca-bundle\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.854816 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.854774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:38.857491 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:38.857468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls\") pod \"sequence-graph-2393a-788d99c97f-2pw96\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") " pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:39.088992 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:39.088958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:39.220417 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:39.220382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"]
Jul 30 17:23:39.223404 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:23:39.223366    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff070ed3_2934_43cb_acd4_a119a03d65b7.slice/crio-1b62de896b7f0c6816f61299ac3863054035689f7d9ebee602cc0ee65a002904 WatchSource:0}: Error finding container 1b62de896b7f0c6816f61299ac3863054035689f7d9ebee602cc0ee65a002904: Status 404 returned error can't find the container with id 1b62de896b7f0c6816f61299ac3863054035689f7d9ebee602cc0ee65a002904
Jul 30 17:23:39.358976 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:39.358933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" event={"ID":"ff070ed3-2934-43cb-acd4-a119a03d65b7","Type":"ContainerStarted","Data":"fdd0a6d16ce636563928adb147ee87a8ca87d51bcadfe244a2f374bcd70a7d56"}
Jul 30 17:23:39.359182 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:39.358996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" event={"ID":"ff070ed3-2934-43cb-acd4-a119a03d65b7","Type":"ContainerStarted","Data":"1b62de896b7f0c6816f61299ac3863054035689f7d9ebee602cc0ee65a002904"}
Jul 30 17:23:39.359182 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:39.359046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:23:39.375554 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:39.375497    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podStartSLOduration=1.375480289 podStartE2EDuration="1.375480289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:23:39.37434755 +0000 UTC m=+1379.527590279" watchObservedRunningTime="2026-07-30 17:23:39.375480289 +0000 UTC m=+1379.528722988"
Jul 30 17:23:45.368291 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:23:45.368258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:30:56.822978 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:56.822942    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"]
Jul 30 17:30:56.823438 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:56.823208    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" containerID="cri-o://a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52" gracePeriod=30
Jul 30 17:30:56.951369 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:56.951332    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"]
Jul 30 17:30:56.951690 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:56.951625    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" containerID="cri-o://f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027" gracePeriod=30
Jul 30 17:30:56.951801 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:56.951656    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kube-rbac-proxy" containerID="cri-o://1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06" gracePeriod=30
Jul 30 17:30:57.033487 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.033423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"]
Jul 30 17:30:57.037090 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.037065    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.040894 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.040869    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-72b8e-kube-rbac-proxy-sar-config\""
Jul 30 17:30:57.041047 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.040869    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-72b8e-predictor-serving-cert\""
Jul 30 17:30:57.051422 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.051392    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"]
Jul 30 17:30:57.123331 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.123249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09c83fa8-7be6-4302-9cc7-ec43a5926271-proxy-tls\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.123466 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.123328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.123466 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.123365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbmks\" (UniqueName: \"kubernetes.io/projected/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-api-access-jbmks\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.224378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.224334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09c83fa8-7be6-4302-9cc7-ec43a5926271-proxy-tls\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.224378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.224384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.224646 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.224403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbmks\" (UniqueName: \"kubernetes.io/projected/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-api-access-jbmks\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.225053 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.225029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.227023 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.227003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09c83fa8-7be6-4302-9cc7-ec43a5926271-proxy-tls\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.231682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.231663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbmks\" (UniqueName: \"kubernetes.io/projected/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-api-access-jbmks\") pod \"success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") " pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.349094 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.349049    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.478740 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.478702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"]
Jul 30 17:30:57.481712 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:30:57.481687    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c83fa8_7be6_4302_9cc7_ec43a5926271.slice/crio-c632e25159d33b469e7917fed7faefa782b7e6464475e0fb29f5a2f3e28bdc6b WatchSource:0}: Error finding container c632e25159d33b469e7917fed7faefa782b7e6464475e0fb29f5a2f3e28bdc6b: Status 404 returned error can't find the container with id c632e25159d33b469e7917fed7faefa782b7e6464475e0fb29f5a2f3e28bdc6b
Jul 30 17:30:57.924169 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.924119    2560 generic.go:356] "Generic (PLEG): container finished" podID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerID="1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06" exitCode=2
Jul 30 17:30:57.924611 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.924177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" event={"ID":"9b1fc519-8c47-41d3-9475-2cd48e10296d","Type":"ContainerDied","Data":"1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06"}
Jul 30 17:30:57.925951 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.925929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" event={"ID":"09c83fa8-7be6-4302-9cc7-ec43a5926271","Type":"ContainerStarted","Data":"78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658"}
Jul 30 17:30:57.926061 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.925978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" event={"ID":"09c83fa8-7be6-4302-9cc7-ec43a5926271","Type":"ContainerStarted","Data":"716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f"}
Jul 30 17:30:57.926061 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.925999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" event={"ID":"09c83fa8-7be6-4302-9cc7-ec43a5926271","Type":"ContainerStarted","Data":"c632e25159d33b469e7917fed7faefa782b7e6464475e0fb29f5a2f3e28bdc6b"}
Jul 30 17:30:57.926200 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.926076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:57.943902 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:57.943852    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podStartSLOduration=0.943834602 podStartE2EDuration="943.834602ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:30:57.942446204 +0000 UTC m=+1818.095688936" watchObservedRunningTime="2026-07-30 17:30:57.943834602 +0000 UTC m=+1818.097077305"
Jul 30 17:30:58.930653 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:58.930623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:30:58.931967 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:58.931940    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 30 17:30:59.163420 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:59.163374    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:30:59.928856 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:59.928820    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused"
Jul 30 17:30:59.933733 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:59.933700    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 30 17:30:59.934662 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:30:59.934633    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 30 17:31:00.298351 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.298326    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:31:00.351375 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.351339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-rbac-proxy-sar-config\") pod \"9b1fc519-8c47-41d3-9475-2cd48e10296d\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") "
Jul 30 17:31:00.351543 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.351390    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls\") pod \"9b1fc519-8c47-41d3-9475-2cd48e10296d\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") "
Jul 30 17:31:00.351543 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.351411    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9f8w\" (UniqueName: \"kubernetes.io/projected/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-api-access-d9f8w\") pod \"9b1fc519-8c47-41d3-9475-2cd48e10296d\" (UID: \"9b1fc519-8c47-41d3-9475-2cd48e10296d\") "
Jul 30 17:31:00.351716 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.351684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9b1fc519-8c47-41d3-9475-2cd48e10296d" (UID: "9b1fc519-8c47-41d3-9475-2cd48e10296d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:31:00.353548 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.353513    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9b1fc519-8c47-41d3-9475-2cd48e10296d" (UID: "9b1fc519-8c47-41d3-9475-2cd48e10296d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:31:00.353639 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.353621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-api-access-d9f8w" (OuterVolumeSpecName: "kube-api-access-d9f8w") pod "9b1fc519-8c47-41d3-9475-2cd48e10296d" (UID: "9b1fc519-8c47-41d3-9475-2cd48e10296d"). InnerVolumeSpecName "kube-api-access-d9f8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:31:00.452457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.452415    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:00.452457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.452449    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9b1fc519-8c47-41d3-9475-2cd48e10296d-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:00.452457 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.452463    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9f8w\" (UniqueName: \"kubernetes.io/projected/9b1fc519-8c47-41d3-9475-2cd48e10296d-kube-api-access-d9f8w\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:00.939160 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.939106    2560 generic.go:356] "Generic (PLEG): container finished" podID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerID="f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027" exitCode=0
Jul 30 17:31:00.939605 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.939226    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"
Jul 30 17:31:00.939605 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.939222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" event={"ID":"9b1fc519-8c47-41d3-9475-2cd48e10296d","Type":"ContainerDied","Data":"f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027"}
Jul 30 17:31:00.939605 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.939390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm" event={"ID":"9b1fc519-8c47-41d3-9475-2cd48e10296d","Type":"ContainerDied","Data":"d37b4413265e82f265ac2f5463948128096c2aac9a742888edbf2ef5e57583ff"}
Jul 30 17:31:00.939605 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.939439    2560 scope.go:117] "RemoveContainer" containerID="1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06"
Jul 30 17:31:00.947814 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.947794    2560 scope.go:117] "RemoveContainer" containerID="f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027"
Jul 30 17:31:00.955686 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.955663    2560 scope.go:117] "RemoveContainer" containerID="1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06"
Jul 30 17:31:00.956005 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:31:00.955984    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06\": container with ID starting with 1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06 not found: ID does not exist" containerID="1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06"
Jul 30 17:31:00.956100 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.956014    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06"} err="failed to get container status \"1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06\": rpc error: code = NotFound desc = could not find container \"1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06\": container with ID starting with 1ea08d883ff6869a999de2f63a48a76e2dedae3543a5498f23b5ec543d7eee06 not found: ID does not exist"
Jul 30 17:31:00.956100 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.956033    2560 scope.go:117] "RemoveContainer" containerID="f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027"
Jul 30 17:31:00.956318 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:31:00.956301    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027\": container with ID starting with f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027 not found: ID does not exist" containerID="f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027"
Jul 30 17:31:00.956378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.956321    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027"} err="failed to get container status \"f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027\": rpc error: code = NotFound desc = could not find container \"f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027\": container with ID starting with f4d79adc796497e3094e38261b2bc23ae4e802901cd624fe3c6e54aa168cf027 not found: ID does not exist"
Jul 30 17:31:00.956378 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.956355    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"]
Jul 30 17:31:00.959883 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:00.959860    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ba640-predictor-578f66447f-xk7vm"]
Jul 30 17:31:02.390390 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:02.390354    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" path="/var/lib/kubelet/pods/9b1fc519-8c47-41d3-9475-2cd48e10296d/volumes"
Jul 30 17:31:04.163065 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:04.163024    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:04.940070 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:04.940039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:31:04.940542 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:04.940506    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 30 17:31:09.163300 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:09.163263    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:09.163748 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:09.163372    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:31:14.163548 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:14.163507    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:14.940733 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:14.940696    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 30 17:31:19.163654 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:19.163611    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:24.163317 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:24.163276    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:24.941275 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:24.941237    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 30 17:31:26.962404 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:26.962378    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:31:27.034102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.034058    2560 generic.go:356] "Generic (PLEG): container finished" podID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerID="a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52" exitCode=0
Jul 30 17:31:27.034102 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.034106    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"
Jul 30 17:31:27.034371 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.034116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" event={"ID":"48de9f00-6ce3-4202-b0c8-fcc90dd4d413","Type":"ContainerDied","Data":"a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52"}
Jul 30 17:31:27.034371 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.034194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82" event={"ID":"48de9f00-6ce3-4202-b0c8-fcc90dd4d413","Type":"ContainerDied","Data":"e5ee378678df64effca25bd2d525da8b05fa6571b0431a2dbeccfc74cae40ccf"}
Jul 30 17:31:27.034371 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.034220    2560 scope.go:117] "RemoveContainer" containerID="a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52"
Jul 30 17:31:27.042933 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.042912    2560 scope.go:117] "RemoveContainer" containerID="a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52"
Jul 30 17:31:27.043270 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:31:27.043248    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52\": container with ID starting with a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52 not found: ID does not exist" containerID="a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52"
Jul 30 17:31:27.043335 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.043281    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52"} err="failed to get container status \"a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52\": rpc error: code = NotFound desc = could not find container \"a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52\": container with ID starting with a4bf3a2d76c70f0b5bd77363e7aee87e57d9a93cbd7e7564aba61f1cc64f2b52 not found: ID does not exist"
Jul 30 17:31:27.066076 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.066041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-openshift-service-ca-bundle\") pod \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") "
Jul 30 17:31:27.066246 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.066112    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-proxy-tls\") pod \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\" (UID: \"48de9f00-6ce3-4202-b0c8-fcc90dd4d413\") "
Jul 30 17:31:27.066409 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.066384    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "48de9f00-6ce3-4202-b0c8-fcc90dd4d413" (UID: "48de9f00-6ce3-4202-b0c8-fcc90dd4d413"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:31:27.068300 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.068267    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "48de9f00-6ce3-4202-b0c8-fcc90dd4d413" (UID: "48de9f00-6ce3-4202-b0c8-fcc90dd4d413"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:31:27.167519 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.167484    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:27.167519 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.167517    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48de9f00-6ce3-4202-b0c8-fcc90dd4d413-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:27.359553 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.359517    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"]
Jul 30 17:31:27.363894 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:27.363862    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-ba640-6649dcf585-g8z82"]
Jul 30 17:31:28.390311 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:28.390278    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" path="/var/lib/kubelet/pods/48de9f00-6ce3-4202-b0c8-fcc90dd4d413/volumes"
Jul 30 17:31:34.940922 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:34.940880    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 30 17:31:44.941521 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:44.941487    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:31:52.917393 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:52.917357    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"]
Jul 30 17:31:52.917882 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:52.917635    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" containerID="cri-o://fdd0a6d16ce636563928adb147ee87a8ca87d51bcadfe244a2f374bcd70a7d56" gracePeriod=30
Jul 30 17:31:53.035395 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.035356    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"]
Jul 30 17:31:53.035640 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.035612    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" containerID="cri-o://068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da" gracePeriod=30
Jul 30 17:31:53.035717 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.035635    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kube-rbac-proxy" containerID="cri-o://86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce" gracePeriod=30
Jul 30 17:31:53.117279 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117247    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"]
Jul 30 17:31:53.117530 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117518    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640"
Jul 30 17:31:53.117572 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117531    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640"
Jul 30 17:31:53.117572 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117548    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container"
Jul 30 17:31:53.117572 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117553    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container"
Jul 30 17:31:53.117572 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117563    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kube-rbac-proxy"
Jul 30 17:31:53.117572 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117568    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kube-rbac-proxy"
Jul 30 17:31:53.117720 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117613    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kserve-container"
Jul 30 17:31:53.117720 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117619    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b1fc519-8c47-41d3-9475-2cd48e10296d" containerName="kube-rbac-proxy"
Jul 30 17:31:53.117720 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.117626    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="48de9f00-6ce3-4202-b0c8-fcc90dd4d413" containerName="ensemble-graph-ba640"
Jul 30 17:31:53.120399 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.120382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.122475 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.122453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0086b-predictor-serving-cert\""
Jul 30 17:31:53.122604 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.122469    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0086b-kube-rbac-proxy-sar-config\""
Jul 30 17:31:53.129123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.129098    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"]
Jul 30 17:31:53.272624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.272551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hfkb\" (UniqueName: \"kubernetes.io/projected/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-api-access-2hfkb\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.272796 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.272662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-proxy-tls\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.272796 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.272701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.373877 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.373848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-proxy-tls\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.374055 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.373887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.374055 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.373930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hfkb\" (UniqueName: \"kubernetes.io/projected/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-api-access-2hfkb\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.374528 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.374509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.376697 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.376674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-proxy-tls\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.381136 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.381113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hfkb\" (UniqueName: \"kubernetes.io/projected/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-api-access-2hfkb\") pod \"success-200-isvc-0086b-predictor-769897bbf7-xjhbs\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") " pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.431262 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.431224    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:53.563084 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:53.562954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"]
Jul 30 17:31:53.566811 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:31:53.566774    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164c5fe1_fd91_44a5_9acb_d900b2f8d5ee.slice/crio-76a771fe4e39d5abddda7e6675a774e863b8102cd3d61fa15c3b5886b6f9fbe5 WatchSource:0}: Error finding container 76a771fe4e39d5abddda7e6675a774e863b8102cd3d61fa15c3b5886b6f9fbe5: Status 404 returned error can't find the container with id 76a771fe4e39d5abddda7e6675a774e863b8102cd3d61fa15c3b5886b6f9fbe5
Jul 30 17:31:54.139303 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.139263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" event={"ID":"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee","Type":"ContainerStarted","Data":"6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d"}
Jul 30 17:31:54.139776 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.139343    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:54.139776 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.139376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" event={"ID":"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee","Type":"ContainerStarted","Data":"9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d"}
Jul 30 17:31:54.139776 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.139402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" event={"ID":"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee","Type":"ContainerStarted","Data":"76a771fe4e39d5abddda7e6675a774e863b8102cd3d61fa15c3b5886b6f9fbe5"}
Jul 30 17:31:54.139776 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.139430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:31:54.141090 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.141062    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 30 17:31:54.141397 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.141375    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerID="86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce" exitCode=2
Jul 30 17:31:54.141487 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.141418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" event={"ID":"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066","Type":"ContainerDied","Data":"86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce"}
Jul 30 17:31:54.155728 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:54.155675    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podStartSLOduration=1.15565772 podStartE2EDuration="1.15565772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:54.154677728 +0000 UTC m=+1874.307920431" watchObservedRunningTime="2026-07-30 17:31:54.15565772 +0000 UTC m=+1874.308900426"
Jul 30 17:31:55.146286 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:55.146247    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 30 17:31:55.367222 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:55.367182    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:56.143372 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.143332    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.29:8643/healthz\": dial tcp 10.133.0.29:8643: connect: connection refused"
Jul 30 17:31:56.148177 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.148124    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 30 17:31:56.384264 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.384232    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:31:56.499584 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.499550    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-rbac-proxy-sar-config\") pod \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") "
Jul 30 17:31:56.499788 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.499597    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-proxy-tls\") pod \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") "
Jul 30 17:31:56.499788 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.499625    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snhrr\" (UniqueName: \"kubernetes.io/projected/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-api-access-snhrr\") pod \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\" (UID: \"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066\") "
Jul 30 17:31:56.499940 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.499910    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" (UID: "b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:31:56.501935 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.501906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" (UID: "b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:31:56.502038 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.501909    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-api-access-snhrr" (OuterVolumeSpecName: "kube-api-access-snhrr") pod "b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" (UID: "b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066"). InnerVolumeSpecName "kube-api-access-snhrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:31:56.601010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.600974    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:56.601010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.601005    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snhrr\" (UniqueName: \"kubernetes.io/projected/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-api-access-snhrr\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:56.601010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:56.601016    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:31:57.084060 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084024    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"]
Jul 30 17:31:57.084366 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084352    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kube-rbac-proxy"
Jul 30 17:31:57.084418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084368    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kube-rbac-proxy"
Jul 30 17:31:57.084418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084378    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container"
Jul 30 17:31:57.084418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084383    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container"
Jul 30 17:31:57.084506 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084431    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kube-rbac-proxy"
Jul 30 17:31:57.084506 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.084440    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerName="kserve-container"
Jul 30 17:31:57.087133 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.087118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.089242 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.089220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-72b8e-serving-cert\""
Jul 30 17:31:57.089385 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.089368    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-72b8e-kube-rbac-proxy-sar-config\""
Jul 30 17:31:57.095959 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.095934    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"]
Jul 30 17:31:57.155973 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.155936    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" containerID="068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da" exitCode=0
Jul 30 17:31:57.156467 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.155980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" event={"ID":"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066","Type":"ContainerDied","Data":"068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da"}
Jul 30 17:31:57.156467 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.155989    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"
Jul 30 17:31:57.156467 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.156040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4" event={"ID":"b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066","Type":"ContainerDied","Data":"404333c80826708c964d68f34391b775a58114dcbd5a817ccb667452e45cb5e0"}
Jul 30 17:31:57.156467 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.156084    2560 scope.go:117] "RemoveContainer" containerID="86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce"
Jul 30 17:31:57.164613 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.164595    2560 scope.go:117] "RemoveContainer" containerID="068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da"
Jul 30 17:31:57.172290 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.172272    2560 scope.go:117] "RemoveContainer" containerID="86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce"
Jul 30 17:31:57.172536 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:31:57.172518    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce\": container with ID starting with 86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce not found: ID does not exist" containerID="86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce"
Jul 30 17:31:57.172581 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.172547    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce"} err="failed to get container status \"86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce\": rpc error: code = NotFound desc = could not find container \"86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce\": container with ID starting with 86909210ef108aa2e6189f584985b955c8666ee93ca64c62300e14efa932a8ce not found: ID does not exist"
Jul 30 17:31:57.172581 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.172564    2560 scope.go:117] "RemoveContainer" containerID="068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da"
Jul 30 17:31:57.172814 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:31:57.172796    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da\": container with ID starting with 068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da not found: ID does not exist" containerID="068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da"
Jul 30 17:31:57.172854 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.172820    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da"} err="failed to get container status \"068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da\": rpc error: code = NotFound desc = could not find container \"068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da\": container with ID starting with 068d438a799938361f347f1e8b0fb359b9029f14677d715edca2f893ee2426da not found: ID does not exist"
Jul 30 17:31:57.177869 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.177847    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"]
Jul 30 17:31:57.180843 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.180824    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2393a-predictor-7465876489-6ckc4"]
Jul 30 17:31:57.203573 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.203547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42645796-0b79-44fe-b1e9-2743055f1dfd-openshift-service-ca-bundle\") pod \"splitter-graph-72b8e-59fd459df5-jzspv\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") " pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.203700 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.203601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42645796-0b79-44fe-b1e9-2743055f1dfd-proxy-tls\") pod \"splitter-graph-72b8e-59fd459df5-jzspv\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") " pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.304780 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.304745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42645796-0b79-44fe-b1e9-2743055f1dfd-proxy-tls\") pod \"splitter-graph-72b8e-59fd459df5-jzspv\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") " pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.304946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.304808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42645796-0b79-44fe-b1e9-2743055f1dfd-openshift-service-ca-bundle\") pod \"splitter-graph-72b8e-59fd459df5-jzspv\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") " pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.305422 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.305390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42645796-0b79-44fe-b1e9-2743055f1dfd-openshift-service-ca-bundle\") pod \"splitter-graph-72b8e-59fd459df5-jzspv\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") " pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.307341 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.307316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42645796-0b79-44fe-b1e9-2743055f1dfd-proxy-tls\") pod \"splitter-graph-72b8e-59fd459df5-jzspv\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") " pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.397485 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.397395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:57.528907 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:57.528881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"]
Jul 30 17:31:57.531341 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:31:57.531308    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42645796_0b79_44fe_b1e9_2743055f1dfd.slice/crio-0fd5c6a51cdae16c531f10abd552275cede7d0ecf85c2c0355e4efbb4bc56455 WatchSource:0}: Error finding container 0fd5c6a51cdae16c531f10abd552275cede7d0ecf85c2c0355e4efbb4bc56455: Status 404 returned error can't find the container with id 0fd5c6a51cdae16c531f10abd552275cede7d0ecf85c2c0355e4efbb4bc56455
Jul 30 17:31:58.161616 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:58.161570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" event={"ID":"42645796-0b79-44fe-b1e9-2743055f1dfd","Type":"ContainerStarted","Data":"327e8bcdb768d56ff9e661931eb9cbcc1d4d018b5571f5baf08861512ec1d540"}
Jul 30 17:31:58.162034 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:58.161628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" event={"ID":"42645796-0b79-44fe-b1e9-2743055f1dfd","Type":"ContainerStarted","Data":"0fd5c6a51cdae16c531f10abd552275cede7d0ecf85c2c0355e4efbb4bc56455"}
Jul 30 17:31:58.162034 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:58.161714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:31:58.177297 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:58.177247    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podStartSLOduration=1.177230923 podStartE2EDuration="1.177230923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:58.177189876 +0000 UTC m=+1878.330432580" watchObservedRunningTime="2026-07-30 17:31:58.177230923 +0000 UTC m=+1878.330473625"
Jul 30 17:31:58.389702 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:31:58.389668    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066" path="/var/lib/kubelet/pods/b9768ae9-d9f7-4161-bb4c-bfe7f4a2f066/volumes"
Jul 30 17:32:00.150581 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:00.150554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:32:00.151052 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:00.151023    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 30 17:32:00.366330 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:00.366293    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:04.171302 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:04.171233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:32:05.367071 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:05.367022    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:05.367548 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:05.367233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:32:07.171638 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.171599    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"]
Jul 30 17:32:07.172029 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.171853    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" containerID="cri-o://327e8bcdb768d56ff9e661931eb9cbcc1d4d018b5571f5baf08861512ec1d540" gracePeriod=30
Jul 30 17:32:07.307208 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.307171    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"]
Jul 30 17:32:07.307527 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.307475    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container" containerID="cri-o://716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f" gracePeriod=30
Jul 30 17:32:07.307615 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.307562    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kube-rbac-proxy" containerID="cri-o://78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658" gracePeriod=30
Jul 30 17:32:07.360085 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.360047    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"]
Jul 30 17:32:07.364473 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.364455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.367032 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.367007    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-60a78-kube-rbac-proxy-sar-config\""
Jul 30 17:32:07.367032 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.367020    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-60a78-predictor-serving-cert\""
Jul 30 17:32:07.375197 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.375171    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"]
Jul 30 17:32:07.385603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.385574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.385727 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.385634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhl88\" (UniqueName: \"kubernetes.io/projected/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-api-access-rhl88\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.385727 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.385704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.486110 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.486070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.486337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.486137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.486337 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.486198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhl88\" (UniqueName: \"kubernetes.io/projected/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-api-access-rhl88\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.486337 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:32:07.486283    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-60a78-predictor-serving-cert: secret "success-200-isvc-60a78-predictor-serving-cert" not found
Jul 30 17:32:07.486521 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:32:07.486356    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls podName:d67e964b-2155-48bd-ad0c-9d1036f9f80c nodeName:}" failed. No retries permitted until 2026-07-30 17:32:07.986334891 +0000 UTC m=+1888.139577593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls") pod "success-200-isvc-60a78-predictor-bb6796989-qvlbn" (UID: "d67e964b-2155-48bd-ad0c-9d1036f9f80c") : secret "success-200-isvc-60a78-predictor-serving-cert" not found
Jul 30 17:32:07.486868 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.486847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.497993 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.497955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhl88\" (UniqueName: \"kubernetes.io/projected/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-api-access-rhl88\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.989466 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.989426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:07.992113 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:07.992086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls\") pod \"success-200-isvc-60a78-predictor-bb6796989-qvlbn\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") " pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:08.198790 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:08.198755    2560 generic.go:356] "Generic (PLEG): container finished" podID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerID="78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658" exitCode=2
Jul 30 17:32:08.199196 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:08.198823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" event={"ID":"09c83fa8-7be6-4302-9cc7-ec43a5926271","Type":"ContainerDied","Data":"78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658"}
Jul 30 17:32:08.275219 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:08.275106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:08.405428 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:08.405326    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"]
Jul 30 17:32:08.407992 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:32:08.407962    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67e964b_2155_48bd_ad0c_9d1036f9f80c.slice/crio-594014cd6f988444dff1a727864d3cc01c9d77d976b452ecc4100ed2499f855c WatchSource:0}: Error finding container 594014cd6f988444dff1a727864d3cc01c9d77d976b452ecc4100ed2499f855c: Status 404 returned error can't find the container with id 594014cd6f988444dff1a727864d3cc01c9d77d976b452ecc4100ed2499f855c
Jul 30 17:32:09.170425 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.170388    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:09.208701 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.208658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" event={"ID":"d67e964b-2155-48bd-ad0c-9d1036f9f80c","Type":"ContainerStarted","Data":"053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c"}
Jul 30 17:32:09.209099 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.208759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" event={"ID":"d67e964b-2155-48bd-ad0c-9d1036f9f80c","Type":"ContainerStarted","Data":"43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9"}
Jul 30 17:32:09.209099 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.208797    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:09.209099 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.208824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" event={"ID":"d67e964b-2155-48bd-ad0c-9d1036f9f80c","Type":"ContainerStarted","Data":"594014cd6f988444dff1a727864d3cc01c9d77d976b452ecc4100ed2499f855c"}
Jul 30 17:32:09.227204 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.227130    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podStartSLOduration=2.227116669 podStartE2EDuration="2.227116669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:09.22575215 +0000 UTC m=+1889.378994868" watchObservedRunningTime="2026-07-30 17:32:09.227116669 +0000 UTC m=+1889.380359371"
Jul 30 17:32:09.935584 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:09.935535    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused"
Jul 30 17:32:10.151422 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.151376    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 30 17:32:10.212740 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.212660    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:10.213940 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.213910    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 30 17:32:10.366256 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.366217    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:10.667696 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.667672    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:32:10.706751 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.706707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09c83fa8-7be6-4302-9cc7-ec43a5926271-proxy-tls\") pod \"09c83fa8-7be6-4302-9cc7-ec43a5926271\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") "
Jul 30 17:32:10.706948 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.706765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-rbac-proxy-sar-config\") pod \"09c83fa8-7be6-4302-9cc7-ec43a5926271\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") "
Jul 30 17:32:10.706948 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.706795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbmks\" (UniqueName: \"kubernetes.io/projected/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-api-access-jbmks\") pod \"09c83fa8-7be6-4302-9cc7-ec43a5926271\" (UID: \"09c83fa8-7be6-4302-9cc7-ec43a5926271\") "
Jul 30 17:32:10.707176 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.707133    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "09c83fa8-7be6-4302-9cc7-ec43a5926271" (UID: "09c83fa8-7be6-4302-9cc7-ec43a5926271"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:32:10.709200 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.709170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-api-access-jbmks" (OuterVolumeSpecName: "kube-api-access-jbmks") pod "09c83fa8-7be6-4302-9cc7-ec43a5926271" (UID: "09c83fa8-7be6-4302-9cc7-ec43a5926271"). InnerVolumeSpecName "kube-api-access-jbmks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:32:10.709461 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.709441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c83fa8-7be6-4302-9cc7-ec43a5926271-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "09c83fa8-7be6-4302-9cc7-ec43a5926271" (UID: "09c83fa8-7be6-4302-9cc7-ec43a5926271"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:32:10.807438 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.807346    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09c83fa8-7be6-4302-9cc7-ec43a5926271-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:10.807438 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.807378    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:10.807438 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:10.807388    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbmks\" (UniqueName: \"kubernetes.io/projected/09c83fa8-7be6-4302-9cc7-ec43a5926271-kube-api-access-jbmks\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:11.218110 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.218077    2560 generic.go:356] "Generic (PLEG): container finished" podID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerID="716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f" exitCode=0
Jul 30 17:32:11.218512 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.218120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" event={"ID":"09c83fa8-7be6-4302-9cc7-ec43a5926271","Type":"ContainerDied","Data":"716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f"}
Jul 30 17:32:11.218512 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.218198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w" event={"ID":"09c83fa8-7be6-4302-9cc7-ec43a5926271","Type":"ContainerDied","Data":"c632e25159d33b469e7917fed7faefa782b7e6464475e0fb29f5a2f3e28bdc6b"}
Jul 30 17:32:11.218512 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.218226    2560 scope.go:117] "RemoveContainer" containerID="78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658"
Jul 30 17:32:11.218512 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.218127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"
Jul 30 17:32:11.218966 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.218938    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 30 17:32:11.228827 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.228808    2560 scope.go:117] "RemoveContainer" containerID="716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f"
Jul 30 17:32:11.236397 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.236373    2560 scope.go:117] "RemoveContainer" containerID="78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658"
Jul 30 17:32:11.236751 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:32:11.236724    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658\": container with ID starting with 78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658 not found: ID does not exist" containerID="78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658"
Jul 30 17:32:11.236820 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.236763    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658"} err="failed to get container status \"78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658\": rpc error: code = NotFound desc = could not find container \"78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658\": container with ID starting with 78e305d89ba8b306c1255a1b72b3d24d95b74ef755048e32cabf535371579658 not found: ID does not exist"
Jul 30 17:32:11.236820 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.236783    2560 scope.go:117] "RemoveContainer" containerID="716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f"
Jul 30 17:32:11.237121 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:32:11.237094    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f\": container with ID starting with 716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f not found: ID does not exist" containerID="716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f"
Jul 30 17:32:11.237211 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.237131    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f"} err="failed to get container status \"716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f\": rpc error: code = NotFound desc = could not find container \"716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f\": container with ID starting with 716769ca3df2344ccf93e7aaebd182ee9fc8ebe2a836cf100d65b68e4da3401f not found: ID does not exist"
Jul 30 17:32:11.241070 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.241041    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"]
Jul 30 17:32:11.247073 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:11.247050    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-72b8e-predictor-69f4dcbb45-sgp8w"]
Jul 30 17:32:12.389963 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:12.389931    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" path="/var/lib/kubelet/pods/09c83fa8-7be6-4302-9cc7-ec43a5926271/volumes"
Jul 30 17:32:14.170244 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:14.170205    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:15.366279 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:15.366239    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:16.222878 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:16.222850    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:32:16.223319 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:16.223293    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 30 17:32:19.169740 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:19.169704    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:19.170123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:19.169804    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:32:20.151166 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:20.151106    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 30 17:32:20.366915 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:20.366871    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:23.262946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.262854    2560 generic.go:356] "Generic (PLEG): container finished" podID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerID="fdd0a6d16ce636563928adb147ee87a8ca87d51bcadfe244a2f374bcd70a7d56" exitCode=0
Jul 30 17:32:23.262946 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.262921    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" event={"ID":"ff070ed3-2934-43cb-acd4-a119a03d65b7","Type":"ContainerDied","Data":"fdd0a6d16ce636563928adb147ee87a8ca87d51bcadfe244a2f374bcd70a7d56"}
Jul 30 17:32:23.567406 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.567383    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:32:23.605069 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.605038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff070ed3-2934-43cb-acd4-a119a03d65b7-openshift-service-ca-bundle\") pod \"ff070ed3-2934-43cb-acd4-a119a03d65b7\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") "
Jul 30 17:32:23.605248 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.605126    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls\") pod \"ff070ed3-2934-43cb-acd4-a119a03d65b7\" (UID: \"ff070ed3-2934-43cb-acd4-a119a03d65b7\") "
Jul 30 17:32:23.605515 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.605486    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff070ed3-2934-43cb-acd4-a119a03d65b7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ff070ed3-2934-43cb-acd4-a119a03d65b7" (UID: "ff070ed3-2934-43cb-acd4-a119a03d65b7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:32:23.607263 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.607239    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ff070ed3-2934-43cb-acd4-a119a03d65b7" (UID: "ff070ed3-2934-43cb-acd4-a119a03d65b7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:32:23.706470 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.706431    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ff070ed3-2934-43cb-acd4-a119a03d65b7-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:23.706470 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:23.706462    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff070ed3-2934-43cb-acd4-a119a03d65b7-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:24.169576 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.169531    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:24.267674 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.267644    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"
Jul 30 17:32:24.267674 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.267670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96" event={"ID":"ff070ed3-2934-43cb-acd4-a119a03d65b7","Type":"ContainerDied","Data":"1b62de896b7f0c6816f61299ac3863054035689f7d9ebee602cc0ee65a002904"}
Jul 30 17:32:24.268113 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.267730    2560 scope.go:117] "RemoveContainer" containerID="fdd0a6d16ce636563928adb147ee87a8ca87d51bcadfe244a2f374bcd70a7d56"
Jul 30 17:32:24.287807 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.287779    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"]
Jul 30 17:32:24.293568 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.293543    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2393a-788d99c97f-2pw96"]
Jul 30 17:32:24.390310 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:24.390277    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" path="/var/lib/kubelet/pods/ff070ed3-2934-43cb-acd4-a119a03d65b7/volumes"
Jul 30 17:32:26.223945 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:26.223900    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 30 17:32:29.170318 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:29.170274    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:30.151123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:30.151084    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 30 17:32:34.170059 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:34.170014    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:32:36.223998 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:36.223952    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 30 17:32:37.313385 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.313351    2560 generic.go:356] "Generic (PLEG): container finished" podID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerID="327e8bcdb768d56ff9e661931eb9cbcc1d4d018b5571f5baf08861512ec1d540" exitCode=0
Jul 30 17:32:37.313746 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.313413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" event={"ID":"42645796-0b79-44fe-b1e9-2743055f1dfd","Type":"ContainerDied","Data":"327e8bcdb768d56ff9e661931eb9cbcc1d4d018b5571f5baf08861512ec1d540"}
Jul 30 17:32:37.820202 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.820177    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:32:37.912951 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.912908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42645796-0b79-44fe-b1e9-2743055f1dfd-openshift-service-ca-bundle\") pod \"42645796-0b79-44fe-b1e9-2743055f1dfd\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") "
Jul 30 17:32:37.913138 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.912970    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42645796-0b79-44fe-b1e9-2743055f1dfd-proxy-tls\") pod \"42645796-0b79-44fe-b1e9-2743055f1dfd\" (UID: \"42645796-0b79-44fe-b1e9-2743055f1dfd\") "
Jul 30 17:32:37.913290 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.913267    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42645796-0b79-44fe-b1e9-2743055f1dfd-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "42645796-0b79-44fe-b1e9-2743055f1dfd" (UID: "42645796-0b79-44fe-b1e9-2743055f1dfd"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:32:37.915119 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:37.915089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42645796-0b79-44fe-b1e9-2743055f1dfd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "42645796-0b79-44fe-b1e9-2743055f1dfd" (UID: "42645796-0b79-44fe-b1e9-2743055f1dfd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:32:38.013754 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.013660    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42645796-0b79-44fe-b1e9-2743055f1dfd-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:38.013754 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.013697    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42645796-0b79-44fe-b1e9-2743055f1dfd-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:32:38.318125 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.318045    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"
Jul 30 17:32:38.318620 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.318044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv" event={"ID":"42645796-0b79-44fe-b1e9-2743055f1dfd","Type":"ContainerDied","Data":"0fd5c6a51cdae16c531f10abd552275cede7d0ecf85c2c0355e4efbb4bc56455"}
Jul 30 17:32:38.318620 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.318204    2560 scope.go:117] "RemoveContainer" containerID="327e8bcdb768d56ff9e661931eb9cbcc1d4d018b5571f5baf08861512ec1d540"
Jul 30 17:32:38.339851 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.339817    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"]
Jul 30 17:32:38.343594 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.343569    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-72b8e-59fd459df5-jzspv"]
Jul 30 17:32:38.390604 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:38.390570    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" path="/var/lib/kubelet/pods/42645796-0b79-44fe-b1e9-2743055f1dfd/volumes"
Jul 30 17:32:40.151939 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:40.151912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:32:46.223832 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:46.223786    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 30 17:32:53.203255 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203212    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"]
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203511    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kube-rbac-proxy"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203523    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kube-rbac-proxy"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203540    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203549    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203558    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203564    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203572    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e"
Jul 30 17:32:53.203624 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203577    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e"
Jul 30 17:32:53.203869 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203637    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kserve-container"
Jul 30 17:32:53.203869 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203645    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="42645796-0b79-44fe-b1e9-2743055f1dfd" containerName="splitter-graph-72b8e"
Jul 30 17:32:53.203869 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203651    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff070ed3-2934-43cb-acd4-a119a03d65b7" containerName="sequence-graph-2393a"
Jul 30 17:32:53.203869 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.203658    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c83fa8-7be6-4302-9cc7-ec43a5926271" containerName="kube-rbac-proxy"
Jul 30 17:32:53.206673 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.206655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.208978 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.208954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-0086b-serving-cert\""
Jul 30 17:32:53.209260 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.209233    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-0086b-kube-rbac-proxy-sar-config\""
Jul 30 17:32:53.217178 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.217131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"]
Jul 30 17:32:53.325896 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.325860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/462a1b30-4576-4844-b76d-bd170f371971-proxy-tls\") pod \"switch-graph-0086b-5cbb7b6495-b6rl8\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") " pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.325896 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.325904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462a1b30-4576-4844-b76d-bd170f371971-openshift-service-ca-bundle\") pod \"switch-graph-0086b-5cbb7b6495-b6rl8\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") " pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.426889 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.426854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/462a1b30-4576-4844-b76d-bd170f371971-proxy-tls\") pod \"switch-graph-0086b-5cbb7b6495-b6rl8\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") " pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.426889 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.426896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462a1b30-4576-4844-b76d-bd170f371971-openshift-service-ca-bundle\") pod \"switch-graph-0086b-5cbb7b6495-b6rl8\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") " pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.427544 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.427518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462a1b30-4576-4844-b76d-bd170f371971-openshift-service-ca-bundle\") pod \"switch-graph-0086b-5cbb7b6495-b6rl8\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") " pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.429427 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.429407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/462a1b30-4576-4844-b76d-bd170f371971-proxy-tls\") pod \"switch-graph-0086b-5cbb7b6495-b6rl8\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") " pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.517540 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.517443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:53.665605 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:53.665441    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"]
Jul 30 17:32:53.668289 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:32:53.668264    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462a1b30_4576_4844_b76d_bd170f371971.slice/crio-d84ce29beb06baf9b8c4c807ad79a13838455e058c93dc90ec2177fd09f3bcf6 WatchSource:0}: Error finding container d84ce29beb06baf9b8c4c807ad79a13838455e058c93dc90ec2177fd09f3bcf6: Status 404 returned error can't find the container with id d84ce29beb06baf9b8c4c807ad79a13838455e058c93dc90ec2177fd09f3bcf6
Jul 30 17:32:54.375231 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:54.375193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" event={"ID":"462a1b30-4576-4844-b76d-bd170f371971","Type":"ContainerStarted","Data":"2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8"}
Jul 30 17:32:54.375682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:54.375285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" event={"ID":"462a1b30-4576-4844-b76d-bd170f371971","Type":"ContainerStarted","Data":"d84ce29beb06baf9b8c4c807ad79a13838455e058c93dc90ec2177fd09f3bcf6"}
Jul 30 17:32:54.375682 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:54.375317    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:32:54.393750 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:54.393703    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podStartSLOduration=1.393689553 podStartE2EDuration="1.393689553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:32:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:54.393066884 +0000 UTC m=+1934.546309588" watchObservedRunningTime="2026-07-30 17:32:54.393689553 +0000 UTC m=+1934.546932309"
Jul 30 17:32:56.224456 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:32:56.224425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:33:00.390317 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:00.390282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:33:07.481607 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.481569    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"]
Jul 30 17:33:07.484701 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.484685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.488083 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.488057    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-60a78-kube-rbac-proxy-sar-config\""
Jul 30 17:33:07.488600 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.488573    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-60a78-serving-cert\""
Jul 30 17:33:07.501702 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.501679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"]
Jul 30 17:33:07.648603 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.648556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-proxy-tls\") pod \"splitter-graph-60a78-64d9cbc494-wsjkk\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") " pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.648796 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.648618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-openshift-service-ca-bundle\") pod \"splitter-graph-60a78-64d9cbc494-wsjkk\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") " pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.750012 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.749915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-openshift-service-ca-bundle\") pod \"splitter-graph-60a78-64d9cbc494-wsjkk\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") " pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.750012 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.749983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-proxy-tls\") pod \"splitter-graph-60a78-64d9cbc494-wsjkk\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") " pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.750625 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.750599    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-openshift-service-ca-bundle\") pod \"splitter-graph-60a78-64d9cbc494-wsjkk\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") " pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.752681 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.752659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-proxy-tls\") pod \"splitter-graph-60a78-64d9cbc494-wsjkk\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") " pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.794347 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.794307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:07.927363 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:07.927338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"]
Jul 30 17:33:07.929491 ip-10-0-132-155 kubenswrapper[2560]: W0730 17:33:07.929458    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1f6ab7_eba1_47c3_8a2c_c9de76b20e48.slice/crio-5689a6fba76760f7b80d63bb051bd9a5e24fecb89d85f3978dc9e1c40cf07c93 WatchSource:0}: Error finding container 5689a6fba76760f7b80d63bb051bd9a5e24fecb89d85f3978dc9e1c40cf07c93: Status 404 returned error can't find the container with id 5689a6fba76760f7b80d63bb051bd9a5e24fecb89d85f3978dc9e1c40cf07c93
Jul 30 17:33:08.424955 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:08.424908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" event={"ID":"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48","Type":"ContainerStarted","Data":"280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f"}
Jul 30 17:33:08.425126 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:08.424976    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" event={"ID":"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48","Type":"ContainerStarted","Data":"5689a6fba76760f7b80d63bb051bd9a5e24fecb89d85f3978dc9e1c40cf07c93"}
Jul 30 17:33:08.425126 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:08.425017    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:33:08.445950 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:08.445899    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podStartSLOduration=1.445875864 podStartE2EDuration="1.445875864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:33:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:33:08.445622587 +0000 UTC m=+1948.598865288" watchObservedRunningTime="2026-07-30 17:33:08.445875864 +0000 UTC m=+1948.599118571"
Jul 30 17:33:14.433992 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:33:14.433959    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:41:22.154363 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:22.154276    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"]
Jul 30 17:41:22.154903 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:22.154523    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" containerID="cri-o://280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f" gracePeriod=30
Jul 30 17:41:22.283266 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:22.283232    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"]
Jul 30 17:41:22.283469 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:22.283448    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container" containerID="cri-o://43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9" gracePeriod=30
Jul 30 17:41:22.283525 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:22.283482    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kube-rbac-proxy" containerID="cri-o://053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c" gracePeriod=30
Jul 30 17:41:23.203256 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:23.203219    2560 generic.go:356] "Generic (PLEG): container finished" podID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerID="053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c" exitCode=2
Jul 30 17:41:23.203633 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:23.203300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" event={"ID":"d67e964b-2155-48bd-ad0c-9d1036f9f80c","Type":"ContainerDied","Data":"053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c"}
Jul 30 17:41:24.431890 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:24.431851    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:41:25.528660 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.528632    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:41:25.619123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.619032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-rbac-proxy-sar-config\") pod \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") "
Jul 30 17:41:25.619123 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.619096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls\") pod \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") "
Jul 30 17:41:25.619349 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.619139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhl88\" (UniqueName: \"kubernetes.io/projected/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-api-access-rhl88\") pod \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\" (UID: \"d67e964b-2155-48bd-ad0c-9d1036f9f80c\") "
Jul 30 17:41:25.619528 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.619497    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d67e964b-2155-48bd-ad0c-9d1036f9f80c" (UID: "d67e964b-2155-48bd-ad0c-9d1036f9f80c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:41:25.621447 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.621418    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-api-access-rhl88" (OuterVolumeSpecName: "kube-api-access-rhl88") pod "d67e964b-2155-48bd-ad0c-9d1036f9f80c" (UID: "d67e964b-2155-48bd-ad0c-9d1036f9f80c"). InnerVolumeSpecName "kube-api-access-rhl88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:41:25.621447 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.621431    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d67e964b-2155-48bd-ad0c-9d1036f9f80c" (UID: "d67e964b-2155-48bd-ad0c-9d1036f9f80c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:41:25.720350 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.720311    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhl88\" (UniqueName: \"kubernetes.io/projected/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-api-access-rhl88\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:41:25.720350 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.720341    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d67e964b-2155-48bd-ad0c-9d1036f9f80c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:41:25.720350 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:25.720352    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d67e964b-2155-48bd-ad0c-9d1036f9f80c-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:41:26.215790 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.215760    2560 generic.go:356] "Generic (PLEG): container finished" podID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerID="43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9" exitCode=0
Jul 30 17:41:26.215968 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.215811    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"
Jul 30 17:41:26.215968 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.215823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" event={"ID":"d67e964b-2155-48bd-ad0c-9d1036f9f80c","Type":"ContainerDied","Data":"43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9"}
Jul 30 17:41:26.215968 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.215874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn" event={"ID":"d67e964b-2155-48bd-ad0c-9d1036f9f80c","Type":"ContainerDied","Data":"594014cd6f988444dff1a727864d3cc01c9d77d976b452ecc4100ed2499f855c"}
Jul 30 17:41:26.215968 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.215899    2560 scope.go:117] "RemoveContainer" containerID="053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c"
Jul 30 17:41:26.224403 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.224382    2560 scope.go:117] "RemoveContainer" containerID="43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9"
Jul 30 17:41:26.231678 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.231658    2560 scope.go:117] "RemoveContainer" containerID="053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c"
Jul 30 17:41:26.231957 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:41:26.231936    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c\": container with ID starting with 053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c not found: ID does not exist" containerID="053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c"
Jul 30 17:41:26.232005 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.231967    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c"} err="failed to get container status \"053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c\": rpc error: code = NotFound desc = could not find container \"053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c\": container with ID starting with 053aaa3de566c6cdbeee90ba97829839c88b143b86ee59bcd369644756f64a9c not found: ID does not exist"
Jul 30 17:41:26.232005 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.231985    2560 scope.go:117] "RemoveContainer" containerID="43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9"
Jul 30 17:41:26.232241 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:41:26.232223    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9\": container with ID starting with 43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9 not found: ID does not exist" containerID="43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9"
Jul 30 17:41:26.232304 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.232247    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9"} err="failed to get container status \"43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9\": rpc error: code = NotFound desc = could not find container \"43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9\": container with ID starting with 43f3bcd81f1b38307f2552cb29a66112afa6988c66014aa3a5a438f77403cdf9 not found: ID does not exist"
Jul 30 17:41:26.237201 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.237176    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"]
Jul 30 17:41:26.240881 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.240860    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60a78-predictor-bb6796989-qvlbn"]
Jul 30 17:41:26.390667 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:26.390629    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" path="/var/lib/kubelet/pods/d67e964b-2155-48bd-ad0c-9d1036f9f80c/volumes"
Jul 30 17:41:29.432704 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:29.432664    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:41:34.432187 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:34.432125    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:41:34.432594 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:34.432254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:41:39.432193 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:39.432130    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:41:44.431919 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:44.431879    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:41:49.432316 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:49.432272    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:41:52.292514 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.292486    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:41:52.306444 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.306413    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerID="280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f" exitCode=0
Jul 30 17:41:52.306558 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.306454    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"
Jul 30 17:41:52.306558 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.306471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" event={"ID":"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48","Type":"ContainerDied","Data":"280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f"}
Jul 30 17:41:52.306558 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.306515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk" event={"ID":"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48","Type":"ContainerDied","Data":"5689a6fba76760f7b80d63bb051bd9a5e24fecb89d85f3978dc9e1c40cf07c93"}
Jul 30 17:41:52.306558 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.306536    2560 scope.go:117] "RemoveContainer" containerID="280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f"
Jul 30 17:41:52.315289 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.315264    2560 scope.go:117] "RemoveContainer" containerID="280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f"
Jul 30 17:41:52.315598 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:41:52.315572    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f\": container with ID starting with 280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f not found: ID does not exist" containerID="280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f"
Jul 30 17:41:52.315668 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.315616    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f"} err="failed to get container status \"280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f\": rpc error: code = NotFound desc = could not find container \"280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f\": container with ID starting with 280a2472bf2c460580f81bf3e3a5bc12ae145d78cba44d53f6e97247791cb99f not found: ID does not exist"
Jul 30 17:41:52.326069 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.326042    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-openshift-service-ca-bundle\") pod \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") "
Jul 30 17:41:52.326169 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.326136    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-proxy-tls\") pod \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\" (UID: \"7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48\") "
Jul 30 17:41:52.326458 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.326436    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" (UID: "7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:41:52.328357 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.328333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" (UID: "7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:41:52.427699 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.427608    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:41:52.427840 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.427709    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:41:52.622053 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.622023    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"]
Jul 30 17:41:52.624240 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:52.624214    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-60a78-64d9cbc494-wsjkk"]
Jul 30 17:41:54.389631 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:41:54.389596    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" path="/var/lib/kubelet/pods/7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48/volumes"
Jul 30 17:49:12.404814 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.404731    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"]
Jul 30 17:49:12.407311 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.404989    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" containerID="cri-o://2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8" gracePeriod=30
Jul 30 17:49:12.574010 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.573974    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"]
Jul 30 17:49:12.574289 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.574258    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container" containerID="cri-o://9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d" gracePeriod=30
Jul 30 17:49:12.574397 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.574296    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kube-rbac-proxy" containerID="cri-o://6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d" gracePeriod=30
Jul 30 17:49:12.835628 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.835585    2560 generic.go:356] "Generic (PLEG): container finished" podID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerID="6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d" exitCode=2
Jul 30 17:49:12.835797 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:12.835655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" event={"ID":"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee","Type":"ContainerDied","Data":"6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d"}
Jul 30 17:49:15.146900 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.146854    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused"
Jul 30 17:49:15.383097 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.383053    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:49:15.625513 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.625490    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:49:15.772900 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.772809    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hfkb\" (UniqueName: \"kubernetes.io/projected/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-api-access-2hfkb\") pod \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") "
Jul 30 17:49:15.772900 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.772847    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-proxy-tls\") pod \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") "
Jul 30 17:49:15.772900 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.772867    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-rbac-proxy-sar-config\") pod \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\" (UID: \"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee\") "
Jul 30 17:49:15.773303 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.773269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" (UID: "164c5fe1-fd91-44a5-9acb-d900b2f8d5ee"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:49:15.775197 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.775174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-api-access-2hfkb" (OuterVolumeSpecName: "kube-api-access-2hfkb") pod "164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" (UID: "164c5fe1-fd91-44a5-9acb-d900b2f8d5ee"). InnerVolumeSpecName "kube-api-access-2hfkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:49:15.775286 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.775229    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" (UID: "164c5fe1-fd91-44a5-9acb-d900b2f8d5ee"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:49:15.846768 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.846734    2560 generic.go:356] "Generic (PLEG): container finished" podID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerID="9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d" exitCode=0
Jul 30 17:49:15.846928 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.846774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" event={"ID":"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee","Type":"ContainerDied","Data":"9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d"}
Jul 30 17:49:15.846928 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.846788    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"
Jul 30 17:49:15.846928 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.846822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs" event={"ID":"164c5fe1-fd91-44a5-9acb-d900b2f8d5ee","Type":"ContainerDied","Data":"76a771fe4e39d5abddda7e6675a774e863b8102cd3d61fa15c3b5886b6f9fbe5"}
Jul 30 17:49:15.846928 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.846848    2560 scope.go:117] "RemoveContainer" containerID="6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d"
Jul 30 17:49:15.855066 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.855046    2560 scope.go:117] "RemoveContainer" containerID="9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d"
Jul 30 17:49:15.862508 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.862484    2560 scope.go:117] "RemoveContainer" containerID="6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d"
Jul 30 17:49:15.862775 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:49:15.862755    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d\": container with ID starting with 6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d not found: ID does not exist" containerID="6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d"
Jul 30 17:49:15.862834 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.862784    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d"} err="failed to get container status \"6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d\": rpc error: code = NotFound desc = could not find container \"6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d\": container with ID starting with 6a25e66717218da38998a4ee25273eaa1626df11af2d8c740ead18df87f5be5d not found: ID does not exist"
Jul 30 17:49:15.862834 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.862803    2560 scope.go:117] "RemoveContainer" containerID="9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d"
Jul 30 17:49:15.863041 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:49:15.863025    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d\": container with ID starting with 9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d not found: ID does not exist" containerID="9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d"
Jul 30 17:49:15.863081 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.863046    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d"} err="failed to get container status \"9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d\": rpc error: code = NotFound desc = could not find container \"9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d\": container with ID starting with 9b9e430acc60faf3a299932b679ce997106d8e6b2821b33e438a50f4acc0579d not found: ID does not exist"
Jul 30 17:49:15.873537 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.873510    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hfkb\" (UniqueName: \"kubernetes.io/projected/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-api-access-2hfkb\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:49:15.873728 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.873701    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:49:15.873856 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.873734    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee-kube-rbac-proxy-sar-config\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:49:15.875132 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.875109    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"]
Jul 30 17:49:15.877364 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:15.877342    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0086b-predictor-769897bbf7-xjhbs"]
Jul 30 17:49:16.389764 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:16.389730    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" path="/var/lib/kubelet/pods/164c5fe1-fd91-44a5-9acb-d900b2f8d5ee/volumes"
Jul 30 17:49:20.383171 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:20.383123    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:49:25.382313 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:25.382269    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:49:25.382685 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:25.382379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:49:29.283813 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:29.283760    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:30.108326 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:30.108295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:30.382586 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:30.382496    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:49:30.944215 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:30.944184    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:31.747899 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:31.747866    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:32.572423 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:32.572398    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:33.399626 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:33.399596    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:34.229023 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:34.228990    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:35.098779 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:35.098751    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:35.382983 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:35.382883    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:49:35.979760 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:35.979711    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:36.832857 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:36.832818    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:37.822293 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:37.822255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:38.695082 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:38.695045    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:39.557414 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:39.557371    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:40.383169 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:40.383117    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:49:40.426437 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:40.426405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0086b-5cbb7b6495-b6rl8_462a1b30-4576-4844-b76d-bd170f371971/switch-graph-0086b/0.log"
Jul 30 17:49:42.542319 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.542290    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:49:42.674205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.674106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462a1b30-4576-4844-b76d-bd170f371971-openshift-service-ca-bundle\") pod \"462a1b30-4576-4844-b76d-bd170f371971\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") "
Jul 30 17:49:42.674205 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.674167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/462a1b30-4576-4844-b76d-bd170f371971-proxy-tls\") pod \"462a1b30-4576-4844-b76d-bd170f371971\" (UID: \"462a1b30-4576-4844-b76d-bd170f371971\") "
Jul 30 17:49:42.674481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.674458    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462a1b30-4576-4844-b76d-bd170f371971-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "462a1b30-4576-4844-b76d-bd170f371971" (UID: "462a1b30-4576-4844-b76d-bd170f371971"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:49:42.676481 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.676448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/462a1b30-4576-4844-b76d-bd170f371971-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "462a1b30-4576-4844-b76d-bd170f371971" (UID: "462a1b30-4576-4844-b76d-bd170f371971"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:49:42.774660 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.774613    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/462a1b30-4576-4844-b76d-bd170f371971-proxy-tls\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:49:42.774660 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.774656    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462a1b30-4576-4844-b76d-bd170f371971-openshift-service-ca-bundle\") on node \"ip-10-0-132-155.ec2.internal\" DevicePath \"\""
Jul 30 17:49:42.941249 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.941126    2560 generic.go:356] "Generic (PLEG): container finished" podID="462a1b30-4576-4844-b76d-bd170f371971" containerID="2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8" exitCode=0
Jul 30 17:49:42.941249 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.941192    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"
Jul 30 17:49:42.941249 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.941222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" event={"ID":"462a1b30-4576-4844-b76d-bd170f371971","Type":"ContainerDied","Data":"2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8"}
Jul 30 17:49:42.941533 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.941291    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8" event={"ID":"462a1b30-4576-4844-b76d-bd170f371971","Type":"ContainerDied","Data":"d84ce29beb06baf9b8c4c807ad79a13838455e058c93dc90ec2177fd09f3bcf6"}
Jul 30 17:49:42.941533 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.941324    2560 scope.go:117] "RemoveContainer" containerID="2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8"
Jul 30 17:49:42.953475 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.953454    2560 scope.go:117] "RemoveContainer" containerID="2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8"
Jul 30 17:49:42.953772 ip-10-0-132-155 kubenswrapper[2560]: E0730 17:49:42.953752    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8\": container with ID starting with 2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8 not found: ID does not exist" containerID="2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8"
Jul 30 17:49:42.953850 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.953785    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8"} err="failed to get container status \"2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8\": rpc error: code = NotFound desc = could not find container \"2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8\": container with ID starting with 2750e12ea1f8deb8d5382606a9f8995b6bed845f75d0fb6a9f0fd5898be2fef8 not found: ID does not exist"
Jul 30 17:49:42.966045 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.966018    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"]
Jul 30 17:49:42.968577 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:42.968555    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0086b-5cbb7b6495-b6rl8"]
Jul 30 17:49:44.389542 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:44.389509    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="462a1b30-4576-4844-b76d-bd170f371971" path="/var/lib/kubelet/pods/462a1b30-4576-4844-b76d-bd170f371971/volumes"
Jul 30 17:49:47.825195 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:47.825144    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wk2gc_925f02ff-e731-48e7-ae5e-711d2ebfcf0c/global-pull-secret-syncer/0.log"
Jul 30 17:49:47.949707 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:47.949677    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xllkt_cbe285af-ddd9-4852-bd70-a7f439198e83/konnectivity-agent/0.log"
Jul 30 17:49:48.011661 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:48.011636    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-155.ec2.internal_41156b961e58c20ae0176ce2b34a408f/haproxy/0.log"
Jul 30 17:49:52.428626 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:52.428598    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m7z8_3726abb7-66b3-4f85-bec8-f482c2cc5f27/node-exporter/0.log"
Jul 30 17:49:52.458284 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:52.458250    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m7z8_3726abb7-66b3-4f85-bec8-f482c2cc5f27/kube-rbac-proxy/0.log"
Jul 30 17:49:52.487354 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:52.487327    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m7z8_3726abb7-66b3-4f85-bec8-f482c2cc5f27/init-textfile/0.log"
Jul 30 17:49:54.774521 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:54.774491    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-7kpvs_3c4026e4-d57a-45a3-a000-2eb94b3887a0/networking-console-plugin/0.log"
Jul 30 17:49:56.285379 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285339    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"]
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285612    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285625    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285635    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285642    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285660    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kube-rbac-proxy"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285667    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kube-rbac-proxy"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285682    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kube-rbac-proxy"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285690    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kube-rbac-proxy"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285701    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285709    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285720    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container"
Jul 30 17:49:56.285756 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285725    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container"
Jul 30 17:49:56.286116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285771    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kube-rbac-proxy"
Jul 30 17:49:56.286116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285778    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d1f6ab7-eba1-47c3-8a2c-c9de76b20e48" containerName="splitter-graph-60a78"
Jul 30 17:49:56.286116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285784    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67e964b-2155-48bd-ad0c-9d1036f9f80c" containerName="kserve-container"
Jul 30 17:49:56.286116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285790    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kserve-container"
Jul 30 17:49:56.286116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285794    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="164c5fe1-fd91-44a5-9acb-d900b2f8d5ee" containerName="kube-rbac-proxy"
Jul 30 17:49:56.286116 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.285798    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="462a1b30-4576-4844-b76d-bd170f371971" containerName="switch-graph-0086b"
Jul 30 17:49:56.288418 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.288402    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.290760 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.290731    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45p7p\"/\"kube-root-ca.crt\""
Jul 30 17:49:56.290918 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.290792    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45p7p\"/\"openshift-service-ca.crt\""
Jul 30 17:49:56.291459 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.291445    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-45p7p\"/\"default-dockercfg-lhkfc\""
Jul 30 17:49:56.301268 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.301237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"]
Jul 30 17:49:56.369965 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.369916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6wct\" (UniqueName: \"kubernetes.io/projected/e483ccad-2285-4b07-aeae-542f8ade48a0-kube-api-access-q6wct\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.369965 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.369971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-podres\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.370223 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.370022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-proc\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.370223 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.370074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-lib-modules\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.370223 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.370104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-sys\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471197 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-lib-modules\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471197 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-sys\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471477 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6wct\" (UniqueName: \"kubernetes.io/projected/e483ccad-2285-4b07-aeae-542f8ade48a0-kube-api-access-q6wct\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471477 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-podres\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471477 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-sys\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471477 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-proc\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471477 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-lib-modules\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471730 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-podres\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.471730 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.471549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e483ccad-2285-4b07-aeae-542f8ade48a0-proc\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.481053 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.481018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6wct\" (UniqueName: \"kubernetes.io/projected/e483ccad-2285-4b07-aeae-542f8ade48a0-kube-api-access-q6wct\") pod \"perf-node-gather-daemonset-8q285\" (UID: \"e483ccad-2285-4b07-aeae-542f8ade48a0\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.598118 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.598028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:56.728063 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.728021    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"]
Jul 30 17:49:56.989317 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.989281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285" event={"ID":"e483ccad-2285-4b07-aeae-542f8ade48a0","Type":"ContainerStarted","Data":"e93b80691a2b0820ba93b78e65b778d3a9b40579ab230cbfc583b10493985e00"}
Jul 30 17:49:56.989495 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.989332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285" event={"ID":"e483ccad-2285-4b07-aeae-542f8ade48a0","Type":"ContainerStarted","Data":"fed08c23bf6bda6669e2e71cbe81290af78addaecb4d7e83486dbe047a128781"}
Jul 30 17:49:56.989495 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:56.989421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:49:57.011795 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:57.011357    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285" podStartSLOduration=1.011336469 podStartE2EDuration="1.011336469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:49:57.006708448 +0000 UTC m=+2957.159951151" watchObservedRunningTime="2026-07-30 17:49:57.011336469 +0000 UTC m=+2957.164579174"
Jul 30 17:49:57.309597 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:57.309497    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgc8c_02da0d8b-019d-42d4-ad4c-a4274409a975/dns/0.log"
Jul 30 17:49:57.335136 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:57.335101    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dgc8c_02da0d8b-019d-42d4-ad4c-a4274409a975/kube-rbac-proxy/0.log"
Jul 30 17:49:57.417627 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:57.417594    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqddk_8c22ffce-59f6-4289-b6e9-1f53daab03fa/dns-node-resolver/0.log"
Jul 30 17:49:57.938018 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:57.937989    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d4995675-zfsfh_691e8d11-d2a5-452e-8820-40cf2e33489f/registry/0.log"
Jul 30 17:49:58.012488 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:58.012455    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fr8d6_5f8c5cb7-3ff4-419f-b3ed-446b21804bca/node-ca/0.log"
Jul 30 17:49:59.127849 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:59.127817    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pzgqx_76c9a766-8248-43e9-841a-53cc29d8d3bc/serve-healthcheck-canary/0.log"
Jul 30 17:49:59.585742 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:59.585718    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpp5v_589ba723-47e3-445d-8bed-be7dbe18662e/kube-rbac-proxy/0.log"
Jul 30 17:49:59.607955 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:59.607932    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpp5v_589ba723-47e3-445d-8bed-be7dbe18662e/exporter/0.log"
Jul 30 17:49:59.630270 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:49:59.630240    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpp5v_589ba723-47e3-445d-8bed-be7dbe18662e/extractor/0.log"
Jul 30 17:50:02.022469 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:02.022395    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-rd555_934373d5-16d8-4c54-bca1-33b9c47fcf63/server/0.log"
Jul 30 17:50:02.122278 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:02.122248    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-8588677cfb-ptrn4_0ab450d4-7c91-4c10-9ee8-06450f10fd17/manager/0.log"
Jul 30 17:50:03.002344 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:03.002316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-8q285"
Jul 30 17:50:07.670765 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.670733    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/kube-multus-additional-cni-plugins/0.log"
Jul 30 17:50:07.696179 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.696135    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/egress-router-binary-copy/0.log"
Jul 30 17:50:07.718283 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.718257    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/cni-plugins/0.log"
Jul 30 17:50:07.743100 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.743030    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/bond-cni-plugin/0.log"
Jul 30 17:50:07.765322 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.765293    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/routeoverride-cni/0.log"
Jul 30 17:50:07.786961 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.786924    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/whereabouts-cni-bincopy/0.log"
Jul 30 17:50:07.806948 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:07.806923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-72cvr_cbfe8f1f-427a-4a2b-9f7f-ac8a7ca3be03/whereabouts-cni/0.log"
Jul 30 17:50:08.215305 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:08.215273    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vvgrw_ff5e9431-9a26-445d-a7cd-758206dc3dd3/kube-multus/0.log"
Jul 30 17:50:08.236129 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:08.236092    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4pq5s_79e844a3-9703-4b0e-96e6-5b0309fe6e9f/network-metrics-daemon/0.log"
Jul 30 17:50:08.258070 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:08.258043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4pq5s_79e844a3-9703-4b0e-96e6-5b0309fe6e9f/kube-rbac-proxy/0.log"
Jul 30 17:50:09.354063 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.354037    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/ovn-controller/0.log"
Jul 30 17:50:09.375383 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.375360    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/ovn-acl-logging/0.log"
Jul 30 17:50:09.398683 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.398659    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/kube-rbac-proxy-node/0.log"
Jul 30 17:50:09.420687 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.420663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/kube-rbac-proxy-ovn-metrics/0.log"
Jul 30 17:50:09.444995 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.444945    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/northd/0.log"
Jul 30 17:50:09.471192 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.471142    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/nbdb/0.log"
Jul 30 17:50:09.498275 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.498247    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/sbdb/0.log"
Jul 30 17:50:09.551389 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:09.551360    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4rcq_ae892c7f-49c2-4d20-bc9a-68d7941bbc1c/ovnkube-controller/0.log"
Jul 30 17:50:10.904496 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:10.904464    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rn786_1ebc3717-2c14-49d2-98ec-a5edeee7ea9d/network-check-target-container/0.log"
Jul 30 17:50:11.818041 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:11.818003    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vkq8r_9cf5a606-6180-4279-944f-2c7ea8276166/iptables-alerter/0.log"
Jul 30 17:50:12.581189 ip-10-0-132-155 kubenswrapper[2560]: I0730 17:50:12.581144    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cn9nt_6b0fcb6c-0b49-42a2-a9e2-5062284c34c4/tuned/0.log"