Jul 28 17:07:02.234777 ip-10-0-131-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 17:07:02.234791 ip-10-0-131-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 17:07:02.234801 ip-10-0-131-184 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 17:07:02.235249 ip-10-0-131-184 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 17:07:13.554163 ip-10-0-131-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 17:07:13.554180 ip-10-0-131-184 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 18462684c68c4477a17c8fa8eae611a5 --
Jul 28 17:08:54.181546 ip-10-0-131-184 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 17:08:54.664856 ip-10-0-131-184 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:08:54.664856 ip-10-0-131-184 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 17:08:54.664856 ip-10-0-131-184 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:08:54.664856 ip-10-0-131-184 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 17:08:54.664856 ip-10-0-131-184 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:08:54.667252 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.667162    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 17:08:54.672112 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672095    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:08:54.672112 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672112    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672116    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672119    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672122    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672125    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672128    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672131    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672134    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672137    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672140    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672143    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672146    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672149    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672153    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672156    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672158    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672162    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672175    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672178    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:08:54.672174 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672181    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672186    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672190    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672193    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672196    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672198    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672201    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672203    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672207    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672209    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672212    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672214    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672217    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672220    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672222    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672225    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672227    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672230    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672232    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672235    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:08:54.672648 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672237    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672240    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672243    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672246    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672248    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672251    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672254    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672256    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672259    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672261    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672277    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672284    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672289    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672294    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672297    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672300    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672303    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672305    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672308    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672311    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:08:54.673180 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672313    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672316    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672318    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672321    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672323    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672326    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672328    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672331    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672333    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672336    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672339    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672342    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672344    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672347    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672350    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672352    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672355    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672357    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672360    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672363    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:08:54.673684 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672365    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672369    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672372    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672375    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672378    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672382    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672384    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672387    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672389    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672392    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672394    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672397    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672400    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672402    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672405    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672407    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672410    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672412    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.672415    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673152    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:08:54.674175 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673159    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673164    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673168    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673171    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673174    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673178    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673180    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673183    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673186    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673190    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673193    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673196    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673199    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673201    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673204    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673206    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673210    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673212    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673215    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:08:54.674687 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673218    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673220    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673223    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673225    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673228    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673231    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673233    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673236    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673238    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673241    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673243    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673246    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673249    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673251    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673254    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673256    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673259    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673261    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673279    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673282    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:08:54.675173 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673284    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673287    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673297    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673301    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673304    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673306    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673309    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673312    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673315    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673317    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673321    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673324    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673326    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673329    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673331    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673334    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673336    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673339    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673341    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673344    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:08:54.675704 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673346    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673349    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673351    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673354    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673356    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673359    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673361    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673364    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673366    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673369    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673372    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673374    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673377    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673379    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673382    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673385    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673388    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673390    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673393    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673395    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:08:54.676201 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673398    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673400    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673403    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673406    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673410    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673414    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673417    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673419    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673422    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673424    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673427    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673430    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673433    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673437    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673440    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673442    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673445    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673448    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673451    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:08:54.676731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673819    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673824    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673827    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673830    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673833    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673837    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673840    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673844    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673847    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673849    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673852    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673854    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673857    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673860    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673863    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673865    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673868    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673871    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673874    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:08:54.677209 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673876    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673879    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673881    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673884    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673887    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673890    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673894    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673897    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673900    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673903    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673906    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673908    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673911    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673914    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673917    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673919    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673922    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673925    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673927    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:08:54.677691 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673930    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673932    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673935    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673937    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673940    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673942    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673945    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673947    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673950    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673953    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673956    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673958    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673961    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673963    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673966    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673969    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673971    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673973    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673976    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673979    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:08:54.678243 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673981    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673986    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673989    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673992    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673995    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.673998    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674001    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674003    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674006    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674011    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674014    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674017    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674020    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674023    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674026    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674029    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674032    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674034    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674037    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674039    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:08:54.678754 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674041    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674044    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674046    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674049    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674052    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674054    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674057    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674059    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674062    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674065    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674067    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674070    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674072    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674075    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674077    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674080    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674082    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674085    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674087    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674089    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:08:54.679248 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.674092    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674164    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674172    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674179    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674184    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674188    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674191    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674196    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674200    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674203    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674206    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674209    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674213    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674217    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674220    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674223    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674225    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674229    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674232    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674809    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674813    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674816    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674820    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674824    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 17:08:54.679826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674828    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674831    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674835    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674838    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674842    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674845    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674849    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674852    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674855    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674860    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674863    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674866    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674869    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674872    2579 flags.go:64] FLAG: --enable-server="true"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674876    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674880    2579 flags.go:64] FLAG: --event-burst="100"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674883    2579 flags.go:64] FLAG: --event-qps="50"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674886    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674889    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674892    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674898    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674901    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674904    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674907    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674910    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 17:08:54.680424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674913    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674924    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674927    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674930    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674933    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674935    2579 flags.go:64] FLAG: --feature-gates=""
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674943    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674947    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674950    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674953    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674956    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674959    2579 flags.go:64] FLAG: --help="false"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674962    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-184.ec2.internal"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674965    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674968    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674970    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674974    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674978    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674981    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674985    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674988    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674991    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674994    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.674997    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 17:08:54.681060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675000    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675002    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675005    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675010    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675013    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675015    2579 flags.go:64] FLAG: --lock-file=""
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675019    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675022    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675026    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675031    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675035    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675038    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675041    2579 flags.go:64] FLAG: --logging-format="text"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675044    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675047    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675050    2579 flags.go:64] FLAG: --manifest-url=""
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675053    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675058    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675061    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675065    2579 flags.go:64] FLAG: --max-pods="110"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675068    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675071    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675074    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675077    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675080    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 17:08:54.681728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675083    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675087    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675107    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675111    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675114    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675117    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675120    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675126    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675129    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675132    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675136    2579 flags.go:64] FLAG: --port="10250"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675139    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675142    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1538b278add7855"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675145    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675148    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675151    2579 flags.go:64] FLAG: --register-node="true"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675154    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675158    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675161    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675164    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675167    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675171    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675174    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675177    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675181    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 17:08:54.682375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675184    2579 flags.go:64] FLAG: --runonce="false"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675187    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675190    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675193    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675196    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675199    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675202    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675205    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675208    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675211    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675214    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675217    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675220    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675223    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675225    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675228    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675234    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675238    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675241    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675245    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675248    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675251    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675253    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675256    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675260    2579 flags.go:64] FLAG: --v="2"
Jul 28 17:08:54.683166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675275    2579 flags.go:64] FLAG: --version="false"
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675282    2579 flags.go:64] FLAG: --vmodule=""
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675286    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.675289    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675412    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675416    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675419    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675423    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675427    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675430    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675432    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675435    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675437    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675440    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675443    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675445    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675448    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675450    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675453    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675455    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:08:54.684200 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675458    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675460    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675463    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675465    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675469    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675472    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675475    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675478    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675480    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675483    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675485    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675488    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675491    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675495    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675498    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675501    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675504    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675507    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675509    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675512    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:08:54.684731 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675514    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675517    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675520    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675522    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675525    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675527    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675530    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675534    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675537    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675540    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675543    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675546    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675548    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675551    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675553    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675556    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675560    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675563    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675567    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:08:54.685224 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675569    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675572    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675574    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675577    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675579    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675582    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675586    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675588    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675592    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675594    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675597    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675600    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675602    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675605    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675607    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675610    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675612    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675615    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675618    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675620    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:08:54.685730 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675623    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675625    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675628    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675631    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675633    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675636    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675638    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675641    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675643    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675648    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675650    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675654    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675657    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675660    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675664    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675666    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675669    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675672    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675676    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:08:54.686236 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675679    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675682    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675685    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675687    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.675690    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.676290    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.684170    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.684186    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.684207    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.684213    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684287    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684293    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684297    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684301    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:08:54.686824 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684304    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684307    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684310    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684314    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684319    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684322    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684325    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684327    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684331    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684335    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684338    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684341    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684344    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684347    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684350    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684352    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684355    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684358    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684360    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:08:54.687199 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684363    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684366    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684368    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684371    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684373    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684376    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684380    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684383    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684386    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684388    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684391    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684394    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684396    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684399    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684402    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684404    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684407    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684410    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684413    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684415    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:08:54.687682 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684418    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684420    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684423    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684433    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684436    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684438    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684441    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684444    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684446    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684449    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684451    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684454    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684456    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684459    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684461    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684464    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684466    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684469    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684473    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684475    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:08:54.688185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684478    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684481    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684483    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684486    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684489    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684492    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684495    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684497    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684500    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684503    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684505    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684508    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684511    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684513    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684516    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684518    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684529    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684533    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684535    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684538    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:08:54.688709 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684541    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684543    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684546    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684548    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684551    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684553    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684556    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684558    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684561    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684564    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684567    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684570    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684573    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684575    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684578    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:08:54.689204 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684580    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.684585    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684701    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684707    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684710    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684713    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684716    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684719    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684721    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684724    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684727    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684729    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684732    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684735    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684743    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:08:54.689605 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684746    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684749    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684752    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684756    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684759    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684763    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684765    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684769    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684771    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684774    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684777    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684779    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684783    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684786    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684788    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684791    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684814    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684817    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684822    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:08:54.689984 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684825    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684828    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684832    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684835    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684837    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684840    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684843    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684846    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684848    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684851    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684853    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684856    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684859    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684867    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684870    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684873    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684875    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684877    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684880    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684882    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:08:54.690466 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684885    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684887    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684890    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684892    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684895    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684898    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684901    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684903    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684906    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684908    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684910    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684913    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684915    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684918    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684921    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684923    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684926    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684928    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684930    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684933    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:08:54.690960 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684936    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684938    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684941    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684943    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684946    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684948    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684952    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684954    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684957    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684960    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684962    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684965    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684968    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684970    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684973    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684975    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684978    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684981    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684984    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684986    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:08:54.691538 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684989    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684992    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684996    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.684999    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.685002    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.685005    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:54.685007    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.685012    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.685126    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.688185    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.689883    2579 server.go:1019] "Starting client certificate rotation"
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.689982    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:08:54.692010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.690012    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:08:54.692474 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.692461    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:08:54.693608 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.693589    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:08:54.704112 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.703908    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 28 17:08:54.706644 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.706627    2579 log.go:25] "Validated CRI v1 image API"
Jul 28 17:08:54.707407 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.707388    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 17:08:54.710339 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.710319    2579 fs.go:135] Filesystem UUIDs: map[6fb1d186-bb6a-43ef-8350-ab7db82023ef:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ed27cce0-0ff5-46c0-a6e8-182a5f3cb455:/dev/nvme0n1p3]
Jul 28 17:08:54.710421 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.710338    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 17:08:54.714958 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.714845    2579 manager.go:216] Machine: {Timestamp:2026-07-28 17:08:54.714372549 +0000 UTC m=+0.388325485 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099907 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2358c275a4180427aa90732c489a51 SystemUUID:ec2358c2-75a4-1804-27aa-90732c489a51 BootID:18462684-c68c-4477-a17c-8fa8eae611a5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:16:27:71:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:16:27:71:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:76:e2:cf:59:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 17:08:54.714958 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.714948    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 17:08:54.715113 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.715058    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 17:08:54.718911 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.718885    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 17:08:54.719052 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.718912    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 17:08:54.719771 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.719761    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 17:08:54.719805 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.719773    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 17:08:54.719805 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.719781    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:08:54.719805 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.719792    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:08:54.720688 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.720672    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:08:54.720728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.720719    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 17:08:54.722656 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722645    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:08:54.722781 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722772    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 17:08:54.722819 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722800    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 17:08:54.722819 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722818    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 17:08:54.722877 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722834    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 17:08:54.722877 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722844    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 28 17:08:54.722877 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.722853    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 17:08:54.723219 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.723207    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:08:54.723290 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.723224    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:08:54.726464 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.726448    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 17:08:54.728823 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.728805    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 17:08:54.728899 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.728845    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 17:08:54.730560 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730545    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 17:08:54.730560 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730563    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 17:08:54.730560 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730569    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 17:08:54.730560 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730575    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730584    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730590    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730598    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730603    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730609    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730615    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730633    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 17:08:54.730789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.730638    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 17:08:54.731600 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.731588    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 17:08:54.731600 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.731597    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 17:08:54.734831 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.734716    2579 server.go:1268] "Started kubelet"
Jul 28 17:08:54.734831 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.734786    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 17:08:54.734961 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.734838    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 17:08:54.735037 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.734971    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 17:08:54.735541 ip-10-0-131-184 systemd[1]: Started Kubernetes Kubelet.
Jul 28 17:08:54.735801 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.735781    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 17:08:54.735922 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.735907    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 17:08:54.736626 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.736606    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 17:08:54.736796 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.736781    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 17:08:54.737170 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.737116    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 17:08:54.739562 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.739133    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 17:08:54.743663 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.742416    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-184.ec2.internal.18c6832dbb187c7e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-184.ec2.internal,UID:ip-10-0-131-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-184.ec2.internal,},FirstTimestamp:2026-07-28 17:08:54.734691454 +0000 UTC m=+0.408644389,LastTimestamp:2026-07-28 17:08:54.734691454 +0000 UTC m=+0.408644389,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-184.ec2.internal,}"
Jul 28 17:08:54.745037 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745022    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 17:08:54.745095 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745034    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 17:08:54.745153 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.745100    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:54.745641 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745622    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 17:08:54.745641 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745624    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 17:08:54.745766 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745661    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 17:08:54.745766 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745755    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 17:08:54.745766 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745764    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 17:08:54.745914 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745817    2579 factory.go:55] Registering systemd factory
Jul 28 17:08:54.745914 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.745855    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 28 17:08:54.746155 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.746136    2579 factory.go:153] Registering CRI-O factory
Jul 28 17:08:54.746155 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.746156    2579 factory.go:223] Registration of the crio container factory successfully
Jul 28 17:08:54.746368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.746205    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 17:08:54.746368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.746226    2579 factory.go:103] Registering Raw factory
Jul 28 17:08:54.746368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.746236    2579 manager.go:1196] Started watching for new ooms in manager
Jul 28 17:08:54.746566 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.746550    2579 manager.go:349] Starting recovery of all containers
Jul 28 17:08:54.748469 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.748446    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9r4sj"
Jul 28 17:08:54.751018 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.750990    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 17:08:54.751375 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.751345    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 17:08:54.758375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.758352    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9r4sj"
Jul 28 17:08:54.760147 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.760128    2579 manager.go:354] Recovery completed
Jul 28 17:08:54.766009 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.765996    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:54.767953 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.767934    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:54.768044 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.767968    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:54.768044 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.767981    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:54.768596 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.768579    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 17:08:54.768596 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.768590    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:54.768725 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.768594    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 17:08:54.768725 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.768622    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:08:54.769358 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.769338    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:54.769449 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.769374    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:54.769449 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.769390    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:54.770440 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.770361    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-184.ec2.internal.18c6832dbd13fdf4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-184.ec2.internal,UID:ip-10-0-131-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-184.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-184.ec2.internal,},FirstTimestamp:2026-07-28 17:08:54.767951348 +0000 UTC m=+0.441904285,LastTimestamp:2026-07-28 17:08:54.767951348 +0000 UTC m=+0.441904285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-184.ec2.internal,}"
Jul 28 17:08:54.770817 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.770802    2579 policy_none.go:49] "None policy: Start"
Jul 28 17:08:54.770817 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.770819    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 17:08:54.770921 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.770832    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 17:08:54.771904 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.771893    2579 policy_none.go:47] "Start"
Jul 28 17:08:54.806686 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.806525    2579 manager.go:337] "Starting Device Plugin manager"
Jul 28 17:08:54.806782 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.806713    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 17:08:54.806782 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.806729    2579 server.go:87] "Starting device plugin registration server"
Jul 28 17:08:54.806971 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.806955    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 17:08:54.807022 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.806968    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 17:08:54.807118 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.807078    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 17:08:54.807177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.807164    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 17:08:54.807221 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.807179    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 17:08:54.807782 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.807761    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 17:08:54.807868 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.807814    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:54.907634 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.907605    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:54.909086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.908593    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:54.909086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.908629    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:54.909086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.908643    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:54.909086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.908672    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-184.ec2.internal"
Jul 28 17:08:54.916778 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.916724    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-184.ec2.internal"
Jul 28 17:08:54.916778 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.916752    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-184.ec2.internal\": node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:54.924689 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.924653    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 17:08:54.925905 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.925889    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 17:08:54.925974 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.925926    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 17:08:54.925974 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.925944    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 17:08:54.926046 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.925994    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 17:08:54.928453 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:54.928433    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:08:54.929596 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:54.929578    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.026992 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.026946    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"]
Jul 28 17:08:55.027154 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.027032    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:55.028943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.028926    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:55.029045 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.028962    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:55.029045 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.028976    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:55.030030 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.030013    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.030408 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.030393    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:55.030531 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.030518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.030579 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.030543    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:55.031143 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.031125    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:55.031232 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.031161    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:55.031232 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.031171    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:55.031232 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.031129    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:55.031384 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.031247    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:55.031384 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.031279    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:55.032728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.032713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.032801 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.032736    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:08:55.033429 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.033413    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:08:55.033496 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.033443    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:08:55.033496 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.033463    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:08:55.046816 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.046798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0feefa2c5e96de0b03b7f75cc7fb5cbc-config\") pod \"kube-apiserver-proxy-ip-10-0-131-184.ec2.internal\" (UID: \"0feefa2c5e96de0b03b7f75cc7fb5cbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.046904 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.046825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca2b9c4cba0e384b5ac13ed2a2541c0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"ca2b9c4cba0e384b5ac13ed2a2541c0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.046904 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.046850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca2b9c4cba0e384b5ac13ed2a2541c0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"ca2b9c4cba0e384b5ac13ed2a2541c0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.061018 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.061000    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-184.ec2.internal\" not found" node="ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.065388 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.065371    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-184.ec2.internal\" not found" node="ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.130659 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.130633    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.147829 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.147806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0feefa2c5e96de0b03b7f75cc7fb5cbc-config\") pod \"kube-apiserver-proxy-ip-10-0-131-184.ec2.internal\" (UID: \"0feefa2c5e96de0b03b7f75cc7fb5cbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.147938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.147838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca2b9c4cba0e384b5ac13ed2a2541c0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"ca2b9c4cba0e384b5ac13ed2a2541c0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.147938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.147848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0feefa2c5e96de0b03b7f75cc7fb5cbc-config\") pod \"kube-apiserver-proxy-ip-10-0-131-184.ec2.internal\" (UID: \"0feefa2c5e96de0b03b7f75cc7fb5cbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.147938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.147861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca2b9c4cba0e384b5ac13ed2a2541c0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"ca2b9c4cba0e384b5ac13ed2a2541c0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.147938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.147915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca2b9c4cba0e384b5ac13ed2a2541c0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"ca2b9c4cba0e384b5ac13ed2a2541c0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.148058 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.147939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca2b9c4cba0e384b5ac13ed2a2541c0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal\" (UID: \"ca2b9c4cba0e384b5ac13ed2a2541c0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.231281 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.231208    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.331788 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.331749    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.364278 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.364240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.369383 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.369365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:55.432486 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.432453    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.533328 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.533233    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.634279 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.634225    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.691028 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.691000    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 17:08:55.691496 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.691166    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 17:08:55.735363 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.735330    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.763236 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.763201    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:03:55 +0000 UTC" deadline="2028-04-12 06:12:19.864259106 +0000 UTC"
Jul 28 17:08:55.763236 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:55.763228    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14965h3m24.101034272s"
Jul 28 17:08:55.836058 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.835982    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.936613 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:55.936587    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:55.996346 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:55.996313    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2b9c4cba0e384b5ac13ed2a2541c0b.slice/crio-8f5276e88f8782da541dc9e1adeeeda11d1d890ef909d7d9ab21a9d48bc8f61d WatchSource:0}: Error finding container 8f5276e88f8782da541dc9e1adeeeda11d1d890ef909d7d9ab21a9d48bc8f61d: Status 404 returned error can't find the container with id 8f5276e88f8782da541dc9e1adeeeda11d1d890ef909d7d9ab21a9d48bc8f61d
Jul 28 17:08:55.996837 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:55.996813    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0feefa2c5e96de0b03b7f75cc7fb5cbc.slice/crio-8b5d5e6a3cb8c8cccfb113e5944e8d7092790ef3fbfc56a0f798d610ecd35c8f WatchSource:0}: Error finding container 8b5d5e6a3cb8c8cccfb113e5944e8d7092790ef3fbfc56a0f798d610ecd35c8f: Status 404 returned error can't find the container with id 8b5d5e6a3cb8c8cccfb113e5944e8d7092790ef3fbfc56a0f798d610ecd35c8f
Jul 28 17:08:56.003270 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.003248    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:08:56.037013 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.036969    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:56.094963 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.094864    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:08:56.139519 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.139484    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-184.ec2.internal\" not found"
Jul 28 17:08:56.209523 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.209491    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:08:56.219845 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.219820    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:08:56.246115 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.246089    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:56.264356 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.264333    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:08:56.265673 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.265656    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal"
Jul 28 17:08:56.277933 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.277917    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:08:56.725060 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.725030    2579 apiserver.go:52] "Watching apiserver"
Jul 28 17:08:56.736249 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.736074    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 17:08:56.736547 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.736520    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-45ltp","kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96","openshift-cluster-node-tuning-operator/tuned-wb84s","openshift-dns/node-resolver-sg74h","openshift-image-registry/node-ca-wnblw","openshift-network-diagnostics/network-check-target-mxtvs","openshift-ovn-kubernetes/ovnkube-node-nwb2w","kube-system/konnectivity-agent-gm67k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal","openshift-multus/multus-additional-cni-plugins-m6stf","openshift-multus/multus-kh4q2","openshift-multus/network-metrics-daemon-8tv92","openshift-network-operator/iptables-alerter-44pfn"]
Jul 28 17:08:56.738866 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.738433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:08:56.738866 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.738517    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:08:56.740050 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.740029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:56.740142 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.740105    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:08:56.741918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.741460    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.743277 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.743174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.744254 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.744233    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:08:56.744643 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.744511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 17:08:56.745356 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.744838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.746270 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.745530    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.746646    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.746895    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.747159    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bm2jz\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.747632    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.748014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vl2z5\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.748242    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.748257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwbgf\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.748520    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.748890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.748667    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.751415 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.750544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.753752 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.753730    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.753983 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.753963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 17:08:56.754196 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.754176    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wksfn\""
Jul 28 17:08:56.754550 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.754528    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.755989 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.755377    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.757620 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.757378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.757620 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.757439    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:08:56.758301 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.758278    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 17:08:56.759273 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-device-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.759393 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-systemd\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.759393 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-tmp-dir\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.759393 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.759393 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-sys-fs\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.759629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysconfig\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.759629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-lib-modules\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.759629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:08:56.759629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.759629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4drqc\" (UniqueName: \"kubernetes.io/projected/a8226e79-72ce-4253-9aa6-6b63aca31d28-kube-api-access-4drqc\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.759629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2pnf\" (UniqueName: \"kubernetes.io/projected/b4b56a44-32e8-42a4-a100-7b99e718331c-kube-api-access-d2pnf\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.759967 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-registration-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.759967 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.759967 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b56a44-32e8-42a4-a100-7b99e718331c-host\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.759967 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 17:08:56.759967 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-kubernetes\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.759967 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.759863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8226e79-72ce-4253-9aa6-6b63aca31d28-tmp\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.761723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-hosts-file\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.761795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-socket-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.761860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysctl-conf\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.761912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-host\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.762712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-tuned\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.762914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4b56a44-32e8-42a4-a100-7b99e718331c-serviceca\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.762965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.762994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-modprobe-d\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.763229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysctl-d\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.763261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-run\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.763294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-sys\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.763803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nzr2\" (UniqueName: \"kubernetes.io/projected/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-kube-api-access-4nzr2\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.763837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptcqj\" (UniqueName: \"kubernetes.io/projected/985e10c3-b813-4d6c-a47e-889875e4eec2-kube-api-access-ptcqj\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.763977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpm86\" (UniqueName: \"kubernetes.io/projected/2ca47273-a7a9-4cfc-9906-604a639a3079-kube-api-access-fpm86\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.764400 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.764013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-var-lib-kubelet\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.765766 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.765236    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 17:08:56.767063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.765892    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zlxrn\""
Jul 28 17:08:56.767063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.766103    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jjrll\""
Jul 28 17:08:56.767063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.766322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.767063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.766740    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:08:56.770518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.770499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.770940 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.770915    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 17:08:56.771146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.771133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 17:08:56.771223 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.771184    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d2869\""
Jul 28 17:08:56.771637 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.771478    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.771637 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.771495    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.771637 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.771535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.772904 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.772884    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.772994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.772925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 17:08:56.773826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.773779    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.775309 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.775264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xr86f\""
Jul 28 17:08:56.775434 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.775410    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 17:08:56.775504 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.775431    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 17:08:56.775898 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.775691    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 17:08:56.775898 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.775709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 17:08:56.776294 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.776213    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 17:08:56.776593 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.776572    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 17:08:56.776873 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.776851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 17:08:56.776984 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.776854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k4c84\""
Jul 28 17:08:56.798574 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.798556    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lr4x"
Jul 28 17:08:56.806846 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.806824    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lr4x"
Jul 28 17:08:56.847646 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.847626    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 17:08:56.864686 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-cni-bin\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.864797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-socket-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.864797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864737    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-host\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.864797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-tuned\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.864797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4b56a44-32e8-42a4-a100-7b99e718331c-serviceca\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.865014 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864820    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-host\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865014 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-kubelet\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.865014 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864910    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovnkube-config\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.865014 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.864935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jsq8\" (UniqueName: \"kubernetes.io/projected/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-kube-api-access-6jsq8\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.865248 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a36411a-3b90-45bd-8db0-d13e602573b4-dbus\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.865248 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865113    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 17:08:56.865248 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:56.865248 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-modprobe-d\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865248 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysctl-d\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865248 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-socket-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-run\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-sys\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-modprobe-d\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.865359    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nzr2\" (UniqueName: \"kubernetes.io/projected/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-kube-api-access-4nzr2\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-run-netns\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-var-lib-kubelet\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnwdx\" (UniqueName: \"kubernetes.io/projected/9885c4ad-8159-4736-a8ce-f87dead967eb-kube-api-access-vnwdx\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.865584    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:08:57.365541827 +0000 UTC m=+3.039494767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:08:56.865639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-ovn\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-env-overrides\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cnibin\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4b56a44-32e8-42a4-a100-7b99e718331c-serviceca\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-system-cni-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865770    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-var-lib-kubelet\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-cni-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-tmp-dir\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysctl-d\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-run\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-slash\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-sys\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.865986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a36411a-3b90-45bd-8db0-d13e602573b4-kubelet-config\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-system-cni-dir\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.866216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-tmp-dir\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-sys-fs\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysconfig\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-var-lib-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-sys-fs\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-etc-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysconfig\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-log-socket\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4drqc\" (UniqueName: \"kubernetes.io/projected/a8226e79-72ce-4253-9aa6-6b63aca31d28-kube-api-access-4drqc\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2pnf\" (UniqueName: \"kubernetes.io/projected/b4b56a44-32e8-42a4-a100-7b99e718331c-kube-api-access-d2pnf\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-systemd\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.867146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e498b396-fc1e-44bc-bc18-8744c278927d-cni-binary-copy\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-conf-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-node-log\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866845    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovnkube-script-lib\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-cnibin\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-netns\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e498b396-fc1e-44bc-bc18-8744c278927d-multus-daemon-config\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-multus-certs\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.866955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-etc-kubernetes\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8226e79-72ce-4253-9aa6-6b63aca31d28-tmp\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9885c4ad-8159-4736-a8ce-f87dead967eb-iptables-alerter-script\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-cni-netd\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-os-release\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysctl-conf\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-cni-multus\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868102 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-hostroot\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovn-node-metrics-cert\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-sysctl-conf\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36b38e59-1188-4c97-91ff-431a055d1f06-agent-certs\") pod \"konnectivity-agent-gm67k\" (UID: \"36b38e59-1188-4c97-91ff-431a055d1f06\") " pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptcqj\" (UniqueName: \"kubernetes.io/projected/985e10c3-b813-4d6c-a47e-889875e4eec2-kube-api-access-ptcqj\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpm86\" (UniqueName: \"kubernetes.io/projected/2ca47273-a7a9-4cfc-9906-604a639a3079-kube-api-access-fpm86\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36b38e59-1188-4c97-91ff-431a055d1f06-konnectivity-ca\") pod \"konnectivity-agent-gm67k\" (UID: \"36b38e59-1188-4c97-91ff-431a055d1f06\") " pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-os-release\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-kubelet\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-device-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-systemd\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-k8s-cni-cncf-io\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.867989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-cni-bin\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-lib-modules\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-systemd\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-socket-dir-parent\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-device-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.868987 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9885c4ad-8159-4736-a8ce-f87dead967eb-host-slash\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmspj\" (UniqueName: \"kubernetes.io/projected/15e5d427-15a3-4402-b2c5-7c9679b95ed0-kube-api-access-xmspj\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-lib-modules\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-registration-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b56a44-32e8-42a4-a100-7b99e718331c-host\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-systemd-units\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlcmx\" (UniqueName: \"kubernetes.io/projected/e498b396-fc1e-44bc-bc18-8744c278927d-kube-api-access-xlcmx\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-kubernetes\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-hosts-file\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ca47273-a7a9-4cfc-9906-604a639a3079-registration-dir\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b56a44-32e8-42a4-a100-7b99e718331c-host\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-hosts-file\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.869840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.868726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-kubernetes\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.870821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.870749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8226e79-72ce-4253-9aa6-6b63aca31d28-etc-tuned\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.871586 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.871532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8226e79-72ce-4253-9aa6-6b63aca31d28-tmp\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.875008 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.874972    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:08:56.875008 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.874999    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:08:56.875008 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.875013    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:08:56.875268 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.875073    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:08:57.375054215 +0000 UTC m=+3.049007158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:08:56.876594 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.876281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nzr2\" (UniqueName: \"kubernetes.io/projected/80a6a903-ef6e-4fa0-98e6-bcc0d4d31380-kube-api-access-4nzr2\") pod \"node-resolver-sg74h\" (UID: \"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380\") " pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:56.879195 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.879166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptcqj\" (UniqueName: \"kubernetes.io/projected/985e10c3-b813-4d6c-a47e-889875e4eec2-kube-api-access-ptcqj\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:56.879309 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.879237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpm86\" (UniqueName: \"kubernetes.io/projected/2ca47273-a7a9-4cfc-9906-604a639a3079-kube-api-access-fpm86\") pod \"aws-ebs-csi-driver-node-s4j96\" (UID: \"2ca47273-a7a9-4cfc-9906-604a639a3079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:56.879857 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.879831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4drqc\" (UniqueName: \"kubernetes.io/projected/a8226e79-72ce-4253-9aa6-6b63aca31d28-kube-api-access-4drqc\") pod \"tuned-wb84s\" (UID: \"a8226e79-72ce-4253-9aa6-6b63aca31d28\") " pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:56.881542 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.881501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2pnf\" (UniqueName: \"kubernetes.io/projected/b4b56a44-32e8-42a4-a100-7b99e718331c-kube-api-access-d2pnf\") pod \"node-ca-wnblw\" (UID: \"b4b56a44-32e8-42a4-a100-7b99e718331c\") " pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:56.932359 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.932297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" event={"ID":"ca2b9c4cba0e384b5ac13ed2a2541c0b","Type":"ContainerStarted","Data":"8f5276e88f8782da541dc9e1adeeeda11d1d890ef909d7d9ab21a9d48bc8f61d"}
Jul 28 17:08:56.934430 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.934406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" event={"ID":"0feefa2c5e96de0b03b7f75cc7fb5cbc","Type":"ContainerStarted","Data":"8b5d5e6a3cb8c8cccfb113e5944e8d7092790ef3fbfc56a0f798d610ecd35c8f"}
Jul 28 17:08:56.969285 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-slash\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.969394 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.969394 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-slash\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.969394 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a36411a-3b90-45bd-8db0-d13e602573b4-kubelet-config\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.969394 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-system-cni-dir\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.969614 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969398    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.969614 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.969614 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.969614 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.969614 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a36411a-3b90-45bd-8db0-d13e602573b4-kubelet-config\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.969866 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-system-cni-dir\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.969993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-var-lib-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-etc-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-log-socket\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-var-lib-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-run-ovn-kubernetes\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-log-socket\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-systemd\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-systemd\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-etc-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.970230    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e498b396-fc1e-44bc-bc18-8744c278927d-cni-binary-copy\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-conf-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-node-log\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:56.970342    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:08:57.470323814 +0000 UTC m=+3.144276760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovnkube-script-lib\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-cnibin\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-conf-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-netns\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.970584 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e498b396-fc1e-44bc-bc18-8744c278927d-multus-daemon-config\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-multus-certs\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-etc-kubernetes\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9885c4ad-8159-4736-a8ce-f87dead967eb-iptables-alerter-script\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-cni-netd\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-os-release\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-cni-multus\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-hostroot\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovn-node-metrics-cert\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36b38e59-1188-4c97-91ff-431a055d1f06-agent-certs\") pod \"konnectivity-agent-gm67k\" (UID: \"36b38e59-1188-4c97-91ff-431a055d1f06\") " pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36b38e59-1188-4c97-91ff-431a055d1f06-konnectivity-ca\") pod \"konnectivity-agent-gm67k\" (UID: \"36b38e59-1188-4c97-91ff-431a055d1f06\") " pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-os-release\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-kubelet\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-k8s-cni-cncf-io\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e498b396-fc1e-44bc-bc18-8744c278927d-cni-binary-copy\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-cni-bin\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-socket-dir-parent\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-os-release\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.971518 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9885c4ad-8159-4736-a8ce-f87dead967eb-host-slash\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-cni-multus\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmspj\" (UniqueName: \"kubernetes.io/projected/15e5d427-15a3-4402-b2c5-7c9679b95ed0-kube-api-access-xmspj\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-systemd-units\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-hostroot\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlcmx\" (UniqueName: \"kubernetes.io/projected/e498b396-fc1e-44bc-bc18-8744c278927d-kube-api-access-xlcmx\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovnkube-script-lib\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.970364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-node-log\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-os-release\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-cni-netd\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-cnibin\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971203    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-socket-dir-parent\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-multus-certs\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-systemd-units\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-etc-kubernetes\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-cni-bin\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-cni-bin\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.972498 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9885c4ad-8159-4736-a8ce-f87dead967eb-host-slash\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-kubelet\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-k8s-cni-cncf-io\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovnkube-config\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jsq8\" (UniqueName: \"kubernetes.io/projected/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-kube-api-access-6jsq8\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a36411a-3b90-45bd-8db0-d13e602573b4-dbus\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-run-netns\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnwdx\" (UniqueName: \"kubernetes.io/projected/9885c4ad-8159-4736-a8ce-f87dead967eb-kube-api-access-vnwdx\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e498b396-fc1e-44bc-bc18-8744c278927d-multus-daemon-config\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-ovn\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-env-overrides\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cnibin\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-run-netns\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-system-cni-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-kubelet\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-cni-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971884    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-openvswitch\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.973246 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-multus-cni-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a36411a-3b90-45bd-8db0-d13e602573b4-dbus\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-run-netns\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-run-ovn\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovnkube-config\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.971995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-host-var-lib-kubelet\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.972038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15e5d427-15a3-4402-b2c5-7c9679b95ed0-cnibin\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.972100    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-host-cni-bin\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.972212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e498b396-fc1e-44bc-bc18-8744c278927d-system-cni-dir\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.972655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36b38e59-1188-4c97-91ff-431a055d1f06-konnectivity-ca\") pod \"konnectivity-agent-gm67k\" (UID: \"36b38e59-1188-4c97-91ff-431a055d1f06\") " pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.972799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9885c4ad-8159-4736-a8ce-f87dead967eb-iptables-alerter-script\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.974177 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.973069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-env-overrides\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.974754 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.974206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-ovn-node-metrics-cert\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:56.974754 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.974266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36b38e59-1188-4c97-91ff-431a055d1f06-agent-certs\") pod \"konnectivity-agent-gm67k\" (UID: \"36b38e59-1188-4c97-91ff-431a055d1f06\") " pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:56.987292 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.987016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlcmx\" (UniqueName: \"kubernetes.io/projected/e498b396-fc1e-44bc-bc18-8744c278927d-kube-api-access-xlcmx\") pod \"multus-kh4q2\" (UID: \"e498b396-fc1e-44bc-bc18-8744c278927d\") " pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:56.987409 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.987394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmspj\" (UniqueName: \"kubernetes.io/projected/15e5d427-15a3-4402-b2c5-7c9679b95ed0-kube-api-access-xmspj\") pod \"multus-additional-cni-plugins-m6stf\" (UID: \"15e5d427-15a3-4402-b2c5-7c9679b95ed0\") " pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:56.987894 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.987871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnwdx\" (UniqueName: \"kubernetes.io/projected/9885c4ad-8159-4736-a8ce-f87dead967eb-kube-api-access-vnwdx\") pod \"iptables-alerter-44pfn\" (UID: \"9885c4ad-8159-4736-a8ce-f87dead967eb\") " pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:56.989279 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:56.989235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jsq8\" (UniqueName: \"kubernetes.io/projected/a749cd5b-06f5-4cc4-b30e-c30b7049c99f-kube-api-access-6jsq8\") pod \"ovnkube-node-nwb2w\" (UID: \"a749cd5b-06f5-4cc4-b30e-c30b7049c99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:57.059920 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.059893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96"
Jul 28 17:08:57.073050 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:57.073025    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca47273_a7a9_4cfc_9906_604a639a3079.slice/crio-a82395c4f309f4204767316f6aa660088bbf3351caa7dd7884a3ad45bb1f58de WatchSource:0}: Error finding container a82395c4f309f4204767316f6aa660088bbf3351caa7dd7884a3ad45bb1f58de: Status 404 returned error can't find the container with id a82395c4f309f4204767316f6aa660088bbf3351caa7dd7884a3ad45bb1f58de
Jul 28 17:08:57.075343 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.075294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wb84s"
Jul 28 17:08:57.084281 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:57.084245    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8226e79_72ce_4253_9aa6_6b63aca31d28.slice/crio-9f1707ff4ad5ff43f550cdd55d3467dbd66ad98641850c6f76ca85765ef414d5 WatchSource:0}: Error finding container 9f1707ff4ad5ff43f550cdd55d3467dbd66ad98641850c6f76ca85765ef414d5: Status 404 returned error can't find the container with id 9f1707ff4ad5ff43f550cdd55d3467dbd66ad98641850c6f76ca85765ef414d5
Jul 28 17:08:57.087847 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.087829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-44pfn"
Jul 28 17:08:57.100502 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.100480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sg74h"
Jul 28 17:08:57.105137 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.105118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wnblw"
Jul 28 17:08:57.114135 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.114114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:08:57.122955 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.122934    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:08:57.131826 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.131808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6stf"
Jul 28 17:08:57.136907 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.136890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kh4q2"
Jul 28 17:08:57.375677 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.375586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:08:57.375677 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.375631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:57.375868 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.375741    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:08:57.375868 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.375806    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:08:58.375791425 +0000 UTC m=+4.049744350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:08:57.375868 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.375814    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:08:57.375868 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.375839    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:08:57.375868 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.375853    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:08:57.376085 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.375912    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:08:58.375894434 +0000 UTC m=+4.049847373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:08:57.475956 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.475926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:57.476125 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.476085    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:08:57.476171 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:57.476149    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:08:58.476128412 +0000 UTC m=+4.150081359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:08:57.809767 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.809669    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:03:57 +0000 UTC" deadline="2028-04-29 04:26:39.574733856 +0000 UTC"
Jul 28 17:08:57.809767 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.809725    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15371h17m41.765013475s"
Jul 28 17:08:57.937015 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.936978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96" event={"ID":"2ca47273-a7a9-4cfc-9906-604a639a3079","Type":"ContainerStarted","Data":"a82395c4f309f4204767316f6aa660088bbf3351caa7dd7884a3ad45bb1f58de"}
Jul 28 17:08:57.938165 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:57.938135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wb84s" event={"ID":"a8226e79-72ce-4253-9aa6-6b63aca31d28","Type":"ContainerStarted","Data":"9f1707ff4ad5ff43f550cdd55d3467dbd66ad98641850c6f76ca85765ef414d5"}
Jul 28 17:08:58.154402 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:58.154203    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a6a903_ef6e_4fa0_98e6_bcc0d4d31380.slice/crio-ea7e3cfca34ff95bfc9979acfe0ce1cc9492bd2a76a0724858a7ed21eefd9d0c WatchSource:0}: Error finding container ea7e3cfca34ff95bfc9979acfe0ce1cc9492bd2a76a0724858a7ed21eefd9d0c: Status 404 returned error can't find the container with id ea7e3cfca34ff95bfc9979acfe0ce1cc9492bd2a76a0724858a7ed21eefd9d0c
Jul 28 17:08:58.157920 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:58.157785    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda749cd5b_06f5_4cc4_b30e_c30b7049c99f.slice/crio-ee860b5641cf45fd2ee8030320cb7a3e234687b6307e7ce3f86425b59dc41b12 WatchSource:0}: Error finding container ee860b5641cf45fd2ee8030320cb7a3e234687b6307e7ce3f86425b59dc41b12: Status 404 returned error can't find the container with id ee860b5641cf45fd2ee8030320cb7a3e234687b6307e7ce3f86425b59dc41b12
Jul 28 17:08:58.162352 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:58.162318    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9885c4ad_8159_4736_a8ce_f87dead967eb.slice/crio-7f831cfb05d1288d242e84a31c5b8f6709ef73c39b4381b6af19113cd9c2cab1 WatchSource:0}: Error finding container 7f831cfb05d1288d242e84a31c5b8f6709ef73c39b4381b6af19113cd9c2cab1: Status 404 returned error can't find the container with id 7f831cfb05d1288d242e84a31c5b8f6709ef73c39b4381b6af19113cd9c2cab1
Jul 28 17:08:58.165160 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:58.165138    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b56a44_32e8_42a4_a100_7b99e718331c.slice/crio-0102582ca0ee91a2d1b8c169a47ab52ae980f3794ab077b7fe2067d7d2e53e97 WatchSource:0}: Error finding container 0102582ca0ee91a2d1b8c169a47ab52ae980f3794ab077b7fe2067d7d2e53e97: Status 404 returned error can't find the container with id 0102582ca0ee91a2d1b8c169a47ab52ae980f3794ab077b7fe2067d7d2e53e97
Jul 28 17:08:58.165437 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:58.165411    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode498b396_fc1e_44bc_bc18_8744c278927d.slice/crio-aadf00ea97cbf72f98377c3c0c5b427f84163ecd5557d6f344c77fd54bf4b30d WatchSource:0}: Error finding container aadf00ea97cbf72f98377c3c0c5b427f84163ecd5557d6f344c77fd54bf4b30d: Status 404 returned error can't find the container with id aadf00ea97cbf72f98377c3c0c5b427f84163ecd5557d6f344c77fd54bf4b30d
Jul 28 17:08:58.169155 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:08:58.168060    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b38e59_1188_4c97_91ff_431a055d1f06.slice/crio-432f32a9a9d850c4f3e0c0ec8b287974b4dac649cf3161d34b435a0573299a42 WatchSource:0}: Error finding container 432f32a9a9d850c4f3e0c0ec8b287974b4dac649cf3161d34b435a0573299a42: Status 404 returned error can't find the container with id 432f32a9a9d850c4f3e0c0ec8b287974b4dac649cf3161d34b435a0573299a42
Jul 28 17:08:58.386572 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.386342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:08:58.386732 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.386618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:58.386842 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.386815    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:08:58.386906 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.386885    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:00.386862744 +0000 UTC m=+6.060815692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:08:58.387450 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.387424    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:08:58.387450 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.387454    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:08:58.387626 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.387467    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:08:58.387626 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.387517    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:00.387502291 +0000 UTC m=+6.061455220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:08:58.486943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.486915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:58.487085 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.487066    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:08:58.487148 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.487135    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:00.487112512 +0000 UTC m=+6.161065437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:08:58.811695 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.811585    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:03:57 +0000 UTC" deadline="2028-03-24 10:35:02.611317525 +0000 UTC"
Jul 28 17:08:58.811695 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.811624    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14513h26m3.799698216s"
Jul 28 17:08:58.929075 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.929044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:08:58.929235 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.929168    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:08:58.929640 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.929606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:08:58.929773 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.929712    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:08:58.929843 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.929788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:08:58.929897 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:08:58.929883    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:08:58.953048 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.952539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gm67k" event={"ID":"36b38e59-1188-4c97-91ff-431a055d1f06","Type":"ContainerStarted","Data":"432f32a9a9d850c4f3e0c0ec8b287974b4dac649cf3161d34b435a0573299a42"}
Jul 28 17:08:58.957667 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.957626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wnblw" event={"ID":"b4b56a44-32e8-42a4-a100-7b99e718331c","Type":"ContainerStarted","Data":"0102582ca0ee91a2d1b8c169a47ab52ae980f3794ab077b7fe2067d7d2e53e97"}
Jul 28 17:08:58.971460 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.971432    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca2b9c4cba0e384b5ac13ed2a2541c0b" containerID="eeaec2baa9f677904c98f70281fb5f24deacb27faa6c85271a104e042983094b" exitCode=0
Jul 28 17:08:58.971582 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.971527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" event={"ID":"ca2b9c4cba0e384b5ac13ed2a2541c0b","Type":"ContainerDied","Data":"eeaec2baa9f677904c98f70281fb5f24deacb27faa6c85271a104e042983094b"}
Jul 28 17:08:58.998745 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:58.998711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" event={"ID":"0feefa2c5e96de0b03b7f75cc7fb5cbc","Type":"ContainerStarted","Data":"86f6d7632c4a07d568019ea67b583f0be0a07afc6f5dd70a99b2ae5660ee10b5"}
Jul 28 17:08:59.006779 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:59.006749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerStarted","Data":"6b63cecc0be0442cf97e5ba60251a9715fd53652ba825498b66a59a8c71c3612"}
Jul 28 17:08:59.016675 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:59.016573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kh4q2" event={"ID":"e498b396-fc1e-44bc-bc18-8744c278927d","Type":"ContainerStarted","Data":"aadf00ea97cbf72f98377c3c0c5b427f84163ecd5557d6f344c77fd54bf4b30d"}
Jul 28 17:08:59.033854 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:59.033733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"ee860b5641cf45fd2ee8030320cb7a3e234687b6307e7ce3f86425b59dc41b12"}
Jul 28 17:08:59.070887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:59.070728    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-44pfn" event={"ID":"9885c4ad-8159-4736-a8ce-f87dead967eb","Type":"ContainerStarted","Data":"7f831cfb05d1288d242e84a31c5b8f6709ef73c39b4381b6af19113cd9c2cab1"}
Jul 28 17:08:59.089521 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:08:59.089484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sg74h" event={"ID":"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380","Type":"ContainerStarted","Data":"ea7e3cfca34ff95bfc9979acfe0ce1cc9492bd2a76a0724858a7ed21eefd9d0c"}
Jul 28 17:09:00.108804 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.108702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" event={"ID":"ca2b9c4cba0e384b5ac13ed2a2541c0b","Type":"ContainerStarted","Data":"8d345bb1ccb94836d50ec849346f802f329e18474961185ef221899e66b42246"}
Jul 28 17:09:00.128141 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.128083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-184.ec2.internal" podStartSLOduration=4.128064913 podStartE2EDuration="4.128064913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:08:59.019394652 +0000 UTC m=+4.693347617" watchObservedRunningTime="2026-07-28 17:09:00.128064913 +0000 UTC m=+5.802017863"
Jul 28 17:09:00.406436 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.405674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:00.406436 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.405772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:00.406436 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.405934    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:09:00.406436 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.405957    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:09:00.406436 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.405970    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:00.406436 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.406043    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:04.40602308 +0000 UTC m=+10.079976020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:00.406895 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.406487    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:00.406895 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.406545    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:04.406528944 +0000 UTC m=+10.080481875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:00.506166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.506122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:00.506365 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.506283    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:00.506455 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.506398    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:04.506376959 +0000 UTC m=+10.180329883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:00.929503 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.929466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:00.929685 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.929475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:00.929685 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.929615    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:00.929685 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:00.929658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:00.929875 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.929761    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:00.929875 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:00.929855    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:02.927356 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:02.927320    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:02.927356 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:02.927354    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:02.927925 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:02.927509    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:02.927925 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:02.927655    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:02.927925 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:02.927718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:02.927925 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:02.927796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:04.442627 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:04.442588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:04.443114 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:04.442691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:04.443114 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.442843    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:09:04.443114 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.442864    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:09:04.443114 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.442877    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:04.443114 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.442932    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:12.442913918 +0000 UTC m=+18.116866855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:04.443417 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.443331    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:04.443417 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.443383    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:12.44336591 +0000 UTC m=+18.117318860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:04.543885 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:04.543786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:04.544075 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.543925    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:04.544075 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.543990    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:12.543974001 +0000 UTC m=+18.217926943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:04.927491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:04.927408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:04.927654 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.927524    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:04.927654 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:04.927559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:04.927775 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.927675    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:04.927775 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:04.927734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:04.927875 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:04.927802    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:06.927028 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:06.926992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:06.927645 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:06.927138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:06.927645 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:06.927579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:06.927778 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:06.927670    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:06.927835 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:06.927815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:06.927935 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:06.927903    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:08.926935 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:08.926907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:08.927306 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:08.926907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:08.927306 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:08.926907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:08.927306 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:08.927029    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:08.927306 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:08.927105    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:08.927306 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:08.927203    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:10.926278 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:10.926236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:10.926668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:10.926236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:10.926668 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:10.926397    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:10.926668 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:10.926482    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:10.926668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:10.926236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:10.926668 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:10.926615    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:12.497309 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:12.497251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:12.497333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.497421    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.497440    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.497452    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.497470    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.497508    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:28.497488111 +0000 UTC m=+34.171441047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:12.497851 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.497526    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:28.497516332 +0000 UTC m=+34.171469260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:12.598358 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:12.598327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:12.598522 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.598464    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:12.598593 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.598532    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:28.598512863 +0000 UTC m=+34.272465802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:12.926425 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:12.926386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:12.926425 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:12.926422    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:12.926654 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:12.926389    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:12.926654 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.926526    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:12.926654 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.926627    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:12.926797 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:12.926714    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:14.927486 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:14.927372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:14.927486 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:14.927485    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:14.928028 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:14.927555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:14.928028 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:14.927658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:14.928028 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:14.927686    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:14.928028 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:14.927730    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:16.928368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:16.927387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:16.928368 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:16.927714    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:16.928368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:16.927447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:16.928368 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:16.927810    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:16.928368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:16.927833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:16.928368 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:16.927907    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:17.147193 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.147005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"708fe818871e011441e179cdbdf7b60d67c452a7fa868b179e492026e6d5f366"}
Jul 28 17:09:17.147329 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.147258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"a552a1df9ecf0397dcdfef1fcaf4ad8227a1ab1094a5580330d7bf6660f4ac72"}
Jul 28 17:09:17.147396 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.147328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"08ee83707705229620cd048fa34e4d17de9d28c39f13bf8426ee15f4bdecfb72"}
Jul 28 17:09:17.148650 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.148630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sg74h" event={"ID":"80a6a903-ef6e-4fa0-98e6-bcc0d4d31380","Type":"ContainerStarted","Data":"a88a640eabb440c26fa3386dab5d3eb7bbebe10dd358079b1c37c3c2bb8b3530"}
Jul 28 17:09:17.150073 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.150052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wb84s" event={"ID":"a8226e79-72ce-4253-9aa6-6b63aca31d28","Type":"ContainerStarted","Data":"263935c81c7c54e9835ca7d46d7b7e1d11198b04d1d040f31e3343063c79bec9"}
Jul 28 17:09:17.151567 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.151540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96" event={"ID":"2ca47273-a7a9-4cfc-9906-604a639a3079","Type":"ContainerStarted","Data":"c85083aeaa8461b6a38f2e128c729c8eedef1ab04e8e442fbd88aefaaa5d5a22"}
Jul 28 17:09:17.152896 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.152872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gm67k" event={"ID":"36b38e59-1188-4c97-91ff-431a055d1f06","Type":"ContainerStarted","Data":"bab37c78994ba9e4613bffacb11cd294bcc344ca1b09222fe34c68d1034f9860"}
Jul 28 17:09:17.156682 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.155006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wnblw" event={"ID":"b4b56a44-32e8-42a4-a100-7b99e718331c","Type":"ContainerStarted","Data":"bfe698e481a0d832af7c934d6a7216b880a545472563055e600648e452a136c0"}
Jul 28 17:09:17.157352 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.156889    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e5d427-15a3-4402-b2c5-7c9679b95ed0" containerID="4cf2154640565b907d50d17636517bb57eb4854b7849c2410d25f1534f7bfa23" exitCode=0
Jul 28 17:09:17.157352 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.157083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerDied","Data":"4cf2154640565b907d50d17636517bb57eb4854b7849c2410d25f1534f7bfa23"}
Jul 28 17:09:17.159106 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.159085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kh4q2" event={"ID":"e498b396-fc1e-44bc-bc18-8744c278927d","Type":"ContainerStarted","Data":"d66c6ac94a0caa329b04ecdb0674d6da74c84b57a9459f1960288a4fe4c1298e"}
Jul 28 17:09:17.168654 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.168617    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sg74h" podStartSLOduration=3.587080473 podStartE2EDuration="22.168605s" totalImagesPullingTime="18.581524527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:17.16814243 +0000 UTC m=+22.842095376" watchObservedRunningTime="2026-07-28 17:09:17.168605 +0000 UTC m=+22.842557943"
Jul 28 17:09:17.168886 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.168868    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-184.ec2.internal" podStartSLOduration=21.168863254 podStartE2EDuration="21.168863254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:00.129440475 +0000 UTC m=+5.803393425" watchObservedRunningTime="2026-07-28 17:09:17.168863254 +0000 UTC m=+22.842816199"
Jul 28 17:09:17.188717 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.188680    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kh4q2" podStartSLOduration=3.541326628 podStartE2EDuration="22.188668377s" totalImagesPullingTime="18.647341749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:17.188390773 +0000 UTC m=+22.862343719" watchObservedRunningTime="2026-07-28 17:09:17.188668377 +0000 UTC m=+22.862621321"
Jul 28 17:09:17.208286 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.208228    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wb84s" podStartSLOduration=2.5401004289999998 podStartE2EDuration="22.208214438s" totalImagesPullingTime="19.668114009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:17.207390953 +0000 UTC m=+22.881343897" watchObservedRunningTime="2026-07-28 17:09:17.208214438 +0000 UTC m=+22.882167382"
Jul 28 17:09:17.227086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.227043    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wnblw" podStartSLOduration=3.657635992 podStartE2EDuration="22.227025487s" totalImagesPullingTime="18.569389495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:17.226890769 +0000 UTC m=+22.900843713" watchObservedRunningTime="2026-07-28 17:09:17.227025487 +0000 UTC m=+22.900978432"
Jul 28 17:09:17.246646 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.246597    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gm67k" podStartSLOduration=3.679262468 podStartE2EDuration="22.246578357s" totalImagesPullingTime="18.567315889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:17.246030818 +0000 UTC m=+22.919983757" watchObservedRunningTime="2026-07-28 17:09:17.246578357 +0000 UTC m=+22.920531303"
Jul 28 17:09:17.366621 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.366582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:17.434501 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:17.434452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.165330 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.165295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"92a89f451eef94ce2adde19f776d512da92105cc389fd7b3e5abfbbf2bfa3e37"}
Jul 28 17:09:18.166061 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.165395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"c17c15b3d1eb29b8471409aca4cc40c1f826fb3afb12772876ddf343201f7817"}
Jul 28 17:09:18.166061 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.165445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"dbac5cc5540e4fdf5ef50cbec28191536bde6b328d70ebe6503e66708d5c97d6"}
Jul 28 17:09:18.167089 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.167054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-44pfn" event={"ID":"9885c4ad-8159-4736-a8ce-f87dead967eb","Type":"ContainerStarted","Data":"387da016cd1fa7d67781d162ef49e94b9ca6e9d0561835b7fdcee583314dc5b6"}
Jul 28 17:09:18.184317 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.184284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.187621 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.187570    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-44pfn" podStartSLOduration=4.614619937 podStartE2EDuration="23.187549499s" totalImagesPullingTime="18.572929562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:18.186784114 +0000 UTC m=+23.860737063" watchObservedRunningTime="2026-07-28 17:09:18.187549499 +0000 UTC m=+23.861502445"
Jul 28 17:09:18.282473 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.282439    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.294404 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.294384    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 17:09:18.385939 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.385905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.485209 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.485122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.583486 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.583451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.684871 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.684839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.786134 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.786044    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:18.822802 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.822683    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:09:18.294398104Z","UUID":"a4262585-0258-481d-af37-b16359f30b18","Handler":null,"Name":"","Endpoint":""}
Jul 28 17:09:18.824293 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.824257    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 17:09:18.824423 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.824317    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 17:09:18.927138 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.927104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:18.927343 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.927157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:18.927343 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.927104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:18.927343 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:18.927257    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:18.927506 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:18.927365    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:18.927506 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:18.927452    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:18.957298 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.957258    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:09:18.957836 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:18.957812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:09:19.172283 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.172216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96" event={"ID":"2ca47273-a7a9-4cfc-9906-604a639a3079","Type":"ContainerStarted","Data":"cc633bd43e37b7c1c0a3bf3d3f5dab9d9fea85c8fd0952d5f880193909a9bcf9"}
Jul 28 17:09:19.172786 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.172695    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:09:19.173353 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.173184    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gm67k"
Jul 28 17:09:19.252471 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.252437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:19.476738 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.476700    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:19.577992 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.577965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:19.858481 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.858445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:19.964894 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:19.964649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:20.177032 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.176961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"15853972c4036c0fe8bb2b6200058c4c9c6f17fad7095c11ca85744f3bac9117"}
Jul 28 17:09:20.178845 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.178820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96" event={"ID":"2ca47273-a7a9-4cfc-9906-604a639a3079","Type":"ContainerStarted","Data":"57723d4bfd361ee0ef1f62b2c5f08e5fa84b2a3e5c8287ec029ae71c2a526f60"}
Jul 28 17:09:20.199731 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.199685    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4j96" podStartSLOduration=2.78288044 podStartE2EDuration="25.199669981s" totalImagesPullingTime="22.416789541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:20.199578007 +0000 UTC m=+25.873530952" watchObservedRunningTime="2026-07-28 17:09:20.199669981 +0000 UTC m=+25.873622951"
Jul 28 17:09:20.642500 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.642458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:20.702127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.702088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:20.926882 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.926806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:20.927043 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.926806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:20.927043 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:20.926960    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:20.927043 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:20.926806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:20.927043 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:20.927012    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:20.927298 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:20.927093    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:21.061825 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:21.061781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:21.119635 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:21.119599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:22.185217 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.184952    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e5d427-15a3-4402-b2c5-7c9679b95ed0" containerID="fec0bb0f2cc8f373c1bd2588e6d062e38288afbd3550015d821b5d21a20cc156" exitCode=0
Jul 28 17:09:22.185217 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.185034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerDied","Data":"fec0bb0f2cc8f373c1bd2588e6d062e38288afbd3550015d821b5d21a20cc156"}
Jul 28 17:09:22.189067 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.189045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" event={"ID":"a749cd5b-06f5-4cc4-b30e-c30b7049c99f","Type":"ContainerStarted","Data":"7392adda4bf0f97aca34803f806f7040eeb1df98c6b04836712e8d7712e7cd39"}
Jul 28 17:09:22.189791 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.189776    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:09:22.189882 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.189871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:09:22.189933 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.189925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:09:22.205573 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.205543    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:09:22.205766 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.205690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:09:22.239839 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.239803    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w" podStartSLOduration=8.585284122000001 podStartE2EDuration="27.239791673s" totalImagesPullingTime="18.654507551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:22.237965972 +0000 UTC m=+27.911918935" watchObservedRunningTime="2026-07-28 17:09:22.239791673 +0000 UTC m=+27.913744618"
Jul 28 17:09:22.927084 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.927039    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:22.927084 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.927071    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:22.927368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:22.927039    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:22.927368 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:22.927152    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:22.927368 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:22.927243    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:22.927368 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:22.927349    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:23.724692 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:23.724664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mxtvs"]
Jul 28 17:09:23.725175 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:23.724816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:23.725175 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:23.724919    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:23.727211 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:23.727186    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45ltp"]
Jul 28 17:09:23.727381 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:23.727316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:23.727446 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:23.727419    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:23.727882 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:23.727863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8tv92"]
Jul 28 17:09:23.728007 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:23.727971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:23.728093 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:23.728074    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:24.195379 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.195347    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e5d427-15a3-4402-b2c5-7c9679b95ed0" containerID="978ceb021f84df0800d78cdb9bbd7bc60d8113baf936bf1a5c789ef14d24e015" exitCode=0
Jul 28 17:09:24.195567 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.195434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerDied","Data":"978ceb021f84df0800d78cdb9bbd7bc60d8113baf936bf1a5c789ef14d24e015"}
Jul 28 17:09:24.323938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.323906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:24.422877 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.422847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:24.814669 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.814632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:24.915256 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.915062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:24.926901 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.926881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:24.927005 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:24.926964    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:24.927054 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:24.927040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:24.927147 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:24.927122    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:25.926814 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:25.926753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:25.927150 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:25.926870    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:26.202063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:26.201978    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e5d427-15a3-4402-b2c5-7c9679b95ed0" containerID="021e70f71b1cb2fe0caea16a8b78afc402ae47c49bc4e7e663d2ca9f0ebddf8c" exitCode=0
Jul 28 17:09:26.202063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:26.202041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerDied","Data":"021e70f71b1cb2fe0caea16a8b78afc402ae47c49bc4e7e663d2ca9f0ebddf8c"}
Jul 28 17:09:26.927310 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:26.927258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:26.927310 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:26.927316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:26.928126 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:26.927409    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:26.928126 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:26.927541    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:27.926548 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:27.926517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:27.926723 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:27.926631    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:28.521344 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:28.521312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:28.521362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.521468    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.521486    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.521495    2579 projected.go:196] Error preparing data for projected volume kube-api-access-69crr for pod openshift-network-diagnostics/network-check-target-mxtvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.521506    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.521547    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr podName:5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.521532447 +0000 UTC m=+66.195485381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-69crr" (UniqueName: "kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr") pod "network-check-target-mxtvs" (UID: "5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:09:28.521703 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.521563    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.521555956 +0000 UTC m=+66.195508879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:09:28.622217 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:28.622134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:28.622392 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.622295    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:28.622392 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.622372    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret podName:9a36411a-3b90-45bd-8db0-d13e602573b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.622351686 +0000 UTC m=+66.296304616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret") pod "global-pull-secret-syncer-45ltp" (UID: "9a36411a-3b90-45bd-8db0-d13e602573b4") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:09:28.927172 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:28.927084    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:28.927358 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:28.927092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:28.927358 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.927210    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxtvs" podUID="5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47"
Jul 28 17:09:28.927358 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:28.927263    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45ltp" podUID="9a36411a-3b90-45bd-8db0-d13e602573b4"
Jul 28 17:09:29.926282 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:29.926244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:29.926807 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:29.926363    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:09:30.214660 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.214597    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e5d427-15a3-4402-b2c5-7c9679b95ed0" containerID="3361dde0281564544009f13c45cc3b82ed1946a1dcafb422228978fc147b54de" exitCode=0
Jul 28 17:09:30.214660 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.214652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerDied","Data":"3361dde0281564544009f13c45cc3b82ed1946a1dcafb422228978fc147b54de"}
Jul 28 17:09:30.628934 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.628910    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-184.ec2.internal" event="NodeReady"
Jul 28 17:09:30.629087 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.629034    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 17:09:30.676141 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.676109    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wbvtz"]
Jul 28 17:09:30.678085 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.678062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.678969 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.678950    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t6h6x"]
Jul 28 17:09:30.680804 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.680788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.681286 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.681239    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 17:09:30.681504 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.681490    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zj6nk\""
Jul 28 17:09:30.681559 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.681531    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 17:09:30.683487 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.683330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 17:09:30.683487 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.683330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 17:09:30.683487 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.683477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 17:09:30.683686 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.683490    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6sdzh\""
Jul 28 17:09:30.691396 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.691045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wbvtz"]
Jul 28 17:09:30.691711 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.691677    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t6h6x"]
Jul 28 17:09:30.825308 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.825263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:30.838401 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.838381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmg4\" (UniqueName: \"kubernetes.io/projected/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-kube-api-access-gbmg4\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.838491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.838408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.838491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.838424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-tmp-dir\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.838491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.838438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-config-volume\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.838598 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.838489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4eddd939-47d2-458e-a0c1-0c4ade7a74fc-cert\") pod \"ingress-canary-t6h6x\" (UID: \"4eddd939-47d2-458e-a0c1-0c4ade7a74fc\") " pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.838598 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.838516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxrrl\" (UniqueName: \"kubernetes.io/projected/4eddd939-47d2-458e-a0c1-0c4ade7a74fc-kube-api-access-qxrrl\") pod \"ingress-canary-t6h6x\" (UID: \"4eddd939-47d2-458e-a0c1-0c4ade7a74fc\") " pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.881609 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.881536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:30.926132 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.926106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:09:30.926242 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.926106    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:09:30.930604 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.929131    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-65cz5\""
Jul 28 17:09:30.930604 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.929466    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:09:30.930604 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.929846    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:09:30.930604 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.930370    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:09:30.939011 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.938991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmg4\" (UniqueName: \"kubernetes.io/projected/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-kube-api-access-gbmg4\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.939127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.939127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-tmp-dir\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.939127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-config-volume\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.939127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4eddd939-47d2-458e-a0c1-0c4ade7a74fc-cert\") pod \"ingress-canary-t6h6x\" (UID: \"4eddd939-47d2-458e-a0c1-0c4ade7a74fc\") " pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.939127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrrl\" (UniqueName: \"kubernetes.io/projected/4eddd939-47d2-458e-a0c1-0c4ade7a74fc-kube-api-access-qxrrl\") pod \"ingress-canary-t6h6x\" (UID: \"4eddd939-47d2-458e-a0c1-0c4ade7a74fc\") " pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.939422 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:30.939140    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:09:30.939422 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:30.939205    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:31.43918605 +0000 UTC m=+37.113138994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:09:30.939422 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-tmp-dir\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.940003 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.939983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-config-volume\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.943303 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.943284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4eddd939-47d2-458e-a0c1-0c4ade7a74fc-cert\") pod \"ingress-canary-t6h6x\" (UID: \"4eddd939-47d2-458e-a0c1-0c4ade7a74fc\") " pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.949110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.949085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxrrl\" (UniqueName: \"kubernetes.io/projected/4eddd939-47d2-458e-a0c1-0c4ade7a74fc-kube-api-access-qxrrl\") pod \"ingress-canary-t6h6x\" (UID: \"4eddd939-47d2-458e-a0c1-0c4ade7a74fc\") " pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:30.949191 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.949114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmg4\" (UniqueName: \"kubernetes.io/projected/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-kube-api-access-gbmg4\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:30.993105 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:30.993076    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t6h6x"
Jul 28 17:09:31.121447 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.121237    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t6h6x"]
Jul 28 17:09:31.124460 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:09:31.124431    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eddd939_47d2_458e_a0c1_0c4ade7a74fc.slice/crio-adb3ae9ac7b0813078e6892e4e1c6042984d5954a6d22f03a5ea3693166d9ac4 WatchSource:0}: Error finding container adb3ae9ac7b0813078e6892e4e1c6042984d5954a6d22f03a5ea3693166d9ac4: Status 404 returned error can't find the container with id adb3ae9ac7b0813078e6892e4e1c6042984d5954a6d22f03a5ea3693166d9ac4
Jul 28 17:09:31.217872 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.217770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t6h6x" event={"ID":"4eddd939-47d2-458e-a0c1-0c4ade7a74fc","Type":"ContainerStarted","Data":"adb3ae9ac7b0813078e6892e4e1c6042984d5954a6d22f03a5ea3693166d9ac4"}
Jul 28 17:09:31.220776 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.220753    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e5d427-15a3-4402-b2c5-7c9679b95ed0" containerID="4601042ebbe3a56c735a9ac048c39c67cd6b9e98058e151cd17b7988afcecb7a" exitCode=0
Jul 28 17:09:31.220891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.220788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerDied","Data":"4601042ebbe3a56c735a9ac048c39c67cd6b9e98058e151cd17b7988afcecb7a"}
Jul 28 17:09:31.443302 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.443258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:31.443425 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:31.443366    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:09:31.443425 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:31.443412    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.443399734 +0000 UTC m=+38.117352657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:09:31.926576 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.926543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:09:31.929511 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.929486    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:09:31.929641 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:31.929548    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-24g9l\""
Jul 28 17:09:32.227851 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:32.227741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6stf" event={"ID":"15e5d427-15a3-4402-b2c5-7c9679b95ed0","Type":"ContainerStarted","Data":"db989bd8638e130cfbb0ab5ecb3eb55c21277fc913b4958ce0c4c5e7341f52aa"}
Jul 28 17:09:32.254347 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:32.254291    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m6stf" podStartSLOduration=7.69261136 podStartE2EDuration="37.254256431s" totalImagesPullingTime="29.561645071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:32.254249888 +0000 UTC m=+37.928202834" watchObservedRunningTime="2026-07-28 17:09:32.254256431 +0000 UTC m=+37.928209380"
Jul 28 17:09:32.377368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:32.377328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:32.447235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:32.447204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:32.450023 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:32.450001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:32.450158 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:32.450124    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:09:32.450231 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:32.450183    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:34.450167293 +0000 UTC m=+40.124120223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:09:33.946193 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:33.945936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:34.011561 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:34.011526    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log" limit=1024
Jul 28 17:09:34.234562 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:34.234485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t6h6x" event={"ID":"4eddd939-47d2-458e-a0c1-0c4ade7a74fc","Type":"ContainerStarted","Data":"2ffd77f5610ca85f81f5150da48f0b11ee85596a4df6bdbe80ef8db297d5d001"}
Jul 28 17:09:34.252186 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:34.252148    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t6h6x" podStartSLOduration=1.6890960229999998 podStartE2EDuration="4.252133331s" totalImagesPullingTime="2.563037308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:34.251100932 +0000 UTC m=+39.925053877" watchObservedRunningTime="2026-07-28 17:09:34.252133331 +0000 UTC m=+39.926086275"
Jul 28 17:09:34.465460 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:34.465423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:34.465620 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:34.465535    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:09:34.465620 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:34.465582    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:38.465570934 +0000 UTC m=+44.139523857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:09:38.494044 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:38.494007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:38.494546 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:38.494181    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:09:38.494546 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:38.494262    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:46.494241853 +0000 UTC m=+52.168194798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:09:46.547650 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:46.547607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:09:46.548063 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:46.547764    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:09:46.548063 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:09:46.547827    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:02.547811417 +0000 UTC m=+68.221764341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:09:54.205783 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:09:54.205754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwb2w"
Jul 28 17:10:00.541515 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.541465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:10:00.542011 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.541577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:10:00.545415 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.545396    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:10:00.545681 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.545664    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:10:00.552778 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:10:00.552760    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 17:10:00.552835 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:10:00.552824    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:04.552803346 +0000 UTC m=+130.226756283 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : secret "metrics-daemon-secret" not found
Jul 28 17:10:00.555740 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.555726    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:10:00.567176 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.567157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69crr\" (UniqueName: \"kubernetes.io/projected/5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47-kube-api-access-69crr\") pod \"network-check-target-mxtvs\" (UID: \"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47\") " pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:10:00.640049 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.640022    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-65cz5\""
Jul 28 17:10:00.642231 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.642213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:10:00.645135 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.645115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:10:00.647486 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.647472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:10:00.655380 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.655354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a36411a-3b90-45bd-8db0-d13e602573b4-original-pull-secret\") pod \"global-pull-secret-syncer-45ltp\" (UID: \"9a36411a-3b90-45bd-8db0-d13e602573b4\") " pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:10:00.765296 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.765252    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mxtvs"]
Jul 28 17:10:00.769148 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:10:00.769122    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4c0c21_57cc_47ff_9d08_0b6bd6da2f47.slice/crio-702b7f106f0488f69a3e1d03355d4b6f2791ad6c3206c880432c86ce9f0866e9 WatchSource:0}: Error finding container 702b7f106f0488f69a3e1d03355d4b6f2791ad6c3206c880432c86ce9f0866e9: Status 404 returned error can't find the container with id 702b7f106f0488f69a3e1d03355d4b6f2791ad6c3206c880432c86ce9f0866e9
Jul 28 17:10:00.942699 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:00.942673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45ltp"
Jul 28 17:10:01.057961 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:01.057931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45ltp"]
Jul 28 17:10:01.060938 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:10:01.060912    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a36411a_3b90_45bd_8db0_d13e602573b4.slice/crio-f05f0699eaf2f7f02fa21776aebbb2a79950d4cd14c03cb0c604ba8d085415a8 WatchSource:0}: Error finding container f05f0699eaf2f7f02fa21776aebbb2a79950d4cd14c03cb0c604ba8d085415a8: Status 404 returned error can't find the container with id f05f0699eaf2f7f02fa21776aebbb2a79950d4cd14c03cb0c604ba8d085415a8
Jul 28 17:10:01.294313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:01.294209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45ltp" event={"ID":"9a36411a-3b90-45bd-8db0-d13e602573b4","Type":"ContainerStarted","Data":"f05f0699eaf2f7f02fa21776aebbb2a79950d4cd14c03cb0c604ba8d085415a8"}
Jul 28 17:10:01.295228 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:01.295206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mxtvs" event={"ID":"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47","Type":"ContainerStarted","Data":"702b7f106f0488f69a3e1d03355d4b6f2791ad6c3206c880432c86ce9f0866e9"}
Jul 28 17:10:02.555140 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:02.555098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:10:02.555636 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:10:02.555263    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:10:02.555636 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:10:02.555350    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:34.555331128 +0000 UTC m=+100.229284066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:10:06.310934 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:06.310881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mxtvs" event={"ID":"5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47","Type":"ContainerStarted","Data":"832cbc656a1d6b6ae99940fb0d587bc7719c797ca9577e97ae231a14f43b1011"}
Jul 28 17:10:06.311497 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:06.311005    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:10:06.312346 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:06.312322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45ltp" event={"ID":"9a36411a-3b90-45bd-8db0-d13e602573b4","Type":"ContainerStarted","Data":"78622ea22a091441abfdd322deb190c6c16b03470b5142c170888b67eeac933a"}
Jul 28 17:10:06.335885 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:06.335844    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mxtvs" podStartSLOduration=66.613613391 podStartE2EDuration="1m11.335832393s" totalImagesPullingTime="4.722219002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:06.33344732 +0000 UTC m=+72.007400264" watchObservedRunningTime="2026-07-28 17:10:06.335832393 +0000 UTC m=+72.009785337"
Jul 28 17:10:06.366751 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:06.366707    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-45ltp" podStartSLOduration=66.932654482 podStartE2EDuration="1m11.366694417s" totalImagesPullingTime="4.434039935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:06.365813787 +0000 UTC m=+72.039766731" watchObservedRunningTime="2026-07-28 17:10:06.366694417 +0000 UTC m=+72.040647362"
Jul 28 17:10:34.564144 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:34.564097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:10:34.564624 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:10:34.564214    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:10:34.564624 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:10:34.564294    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:38.56428055 +0000 UTC m=+164.238233486 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:10:37.318161 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:37.318135    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mxtvs"
Jul 28 17:10:59.316071 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.316040    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"]
Jul 28 17:10:59.317951 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.317935    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.322801 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.322776    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 17:10:59.322801 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.322798    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 17:10:59.323029 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.322820    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 17:10:59.323029 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.322849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-b89dk\""
Jul 28 17:10:59.323131 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.323108    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 17:10:59.332877 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.332856    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"]
Jul 28 17:10:59.359063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.359042    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"]
Jul 28 17:10:59.361014 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.360998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.363621 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.363604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 17:10:59.381540 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.381516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"]
Jul 28 17:10:59.421534 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.421507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzsjp\" (UniqueName: \"kubernetes.io/projected/2c857623-8420-44b0-baf7-775f1c8600c0-kube-api-access-lzsjp\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.421633 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.421538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597d58bd-v7twc\" (UID: \"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.421633 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.421566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c857623-8420-44b0-baf7-775f1c8600c0-tmp\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.421750 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.421654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c857623-8420-44b0-baf7-775f1c8600c0-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.421750 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.421693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mj9\" (UniqueName: \"kubernetes.io/projected/dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa-kube-api-access-26mj9\") pod \"managed-serviceaccount-addon-agent-597d58bd-v7twc\" (UID: \"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.522892 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.522867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzsjp\" (UniqueName: \"kubernetes.io/projected/2c857623-8420-44b0-baf7-775f1c8600c0-kube-api-access-lzsjp\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.523001 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.522894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597d58bd-v7twc\" (UID: \"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.523001 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.522922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c857623-8420-44b0-baf7-775f1c8600c0-tmp\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.523001 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.522943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c857623-8420-44b0-baf7-775f1c8600c0-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.523158 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.523063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26mj9\" (UniqueName: \"kubernetes.io/projected/dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa-kube-api-access-26mj9\") pod \"managed-serviceaccount-addon-agent-597d58bd-v7twc\" (UID: \"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.523351 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.523333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c857623-8420-44b0-baf7-775f1c8600c0-tmp\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.525375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.525346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597d58bd-v7twc\" (UID: \"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.525457 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.525416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c857623-8420-44b0-baf7-775f1c8600c0-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.534343 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.534323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mj9\" (UniqueName: \"kubernetes.io/projected/dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa-kube-api-access-26mj9\") pod \"managed-serviceaccount-addon-agent-597d58bd-v7twc\" (UID: \"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.534409 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.534327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzsjp\" (UniqueName: \"kubernetes.io/projected/2c857623-8420-44b0-baf7-775f1c8600c0-kube-api-access-lzsjp\") pod \"klusterlet-addon-workmgr-7b9879bc95-8wwbt\" (UID: \"2c857623-8420-44b0-baf7-775f1c8600c0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.642564 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.642539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"
Jul 28 17:10:59.669367 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.669343    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:10:59.773202 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.773172    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc"]
Jul 28 17:10:59.776652 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:10:59.776626    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbe52cc0_25a9_40fc_89f0_6d8a5c13d4fa.slice/crio-f20dea9777c1d44723da88ef660edc3a70805f9294db77f6ca932402204249af WatchSource:0}: Error finding container f20dea9777c1d44723da88ef660edc3a70805f9294db77f6ca932402204249af: Status 404 returned error can't find the container with id f20dea9777c1d44723da88ef660edc3a70805f9294db77f6ca932402204249af
Jul 28 17:10:59.797644 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:10:59.797622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"]
Jul 28 17:10:59.800185 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:10:59.800163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c857623_8420_44b0_baf7_775f1c8600c0.slice/crio-c2a65b568e17677e47b09b058021be10f45f51a0ced4b44eec268ac7e140c985 WatchSource:0}: Error finding container c2a65b568e17677e47b09b058021be10f45f51a0ced4b44eec268ac7e140c985: Status 404 returned error can't find the container with id c2a65b568e17677e47b09b058021be10f45f51a0ced4b44eec268ac7e140c985
Jul 28 17:11:00.440144 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:00.440098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc" event={"ID":"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa","Type":"ContainerStarted","Data":"f20dea9777c1d44723da88ef660edc3a70805f9294db77f6ca932402204249af"}
Jul 28 17:11:00.441494 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:00.441457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt" event={"ID":"2c857623-8420-44b0-baf7-775f1c8600c0","Type":"ContainerStarted","Data":"c2a65b568e17677e47b09b058021be10f45f51a0ced4b44eec268ac7e140c985"}
Jul 28 17:11:02.449395 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:02.449356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc" event={"ID":"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa","Type":"ContainerStarted","Data":"03d62c3575d8ca797d5de225ef1294fa62555acbf1b697d91eea9f16c4ea6478"}
Jul 28 17:11:02.469045 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:02.468985    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc" podStartSLOduration=0.896260258 podStartE2EDuration="3.468963764s" totalImagesPullingTime="2.572703506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:02.46792738 +0000 UTC m=+128.141880326" watchObservedRunningTime="2026-07-28 17:11:02.468963764 +0000 UTC m=+128.142916709"
Jul 28 17:11:04.455374 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:04.455337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt" event={"ID":"2c857623-8420-44b0-baf7-775f1c8600c0","Type":"ContainerStarted","Data":"e128bad7deaa2585aec1ad17031ad5773d4298277e5990cf921f2cc32d74d694"}
Jul 28 17:11:04.455725 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:04.455570    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:11:04.457107 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:04.457086    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:11:04.475947 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:04.475899    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt" podStartSLOduration=1.574119109 podStartE2EDuration="5.475886314s" totalImagesPullingTime="3.901767205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:04.474881455 +0000 UTC m=+130.148834399" watchObservedRunningTime="2026-07-28 17:11:04.475886314 +0000 UTC m=+130.149839300"
Jul 28 17:11:04.569919 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:04.569870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:11:04.570090 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:11:04.570015    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 17:11:04.570138 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:11:04.570088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:06.570068718 +0000 UTC m=+252.244021656 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : secret "metrics-daemon-secret" not found
Jul 28 17:11:33.688165 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:11:33.688124    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wbvtz" podUID="3e9b89fb-70f1-4b81-8d31-53971f2e18a0"
Jul 28 17:11:34.524608 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:34.524580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:11:34.936782 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:11:34.936744    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:11:38.607110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:38.607073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:11:38.607526 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:11:38.607183    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:11:38.607526 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:11:38.607232    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls podName:3e9b89fb-70f1-4b81-8d31-53971f2e18a0 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:40.607218587 +0000 UTC m=+286.281171509 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls") pod "dns-default-wbvtz" (UID: "3e9b89fb-70f1-4b81-8d31-53971f2e18a0") : secret "dns-default-metrics-tls" not found
Jul 28 17:11:45.926783 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:11:45.926719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:13:02.736063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:02.735976    2579 generic.go:356] "Generic (PLEG): container finished" podID="dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa" containerID="03d62c3575d8ca797d5de225ef1294fa62555acbf1b697d91eea9f16c4ea6478" exitCode=255
Jul 28 17:13:02.736063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:02.736025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc" event={"ID":"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa","Type":"ContainerDied","Data":"03d62c3575d8ca797d5de225ef1294fa62555acbf1b697d91eea9f16c4ea6478"}
Jul 28 17:13:02.741705 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:02.741685    2579 scope.go:117] "RemoveContainer" containerID="03d62c3575d8ca797d5de225ef1294fa62555acbf1b697d91eea9f16c4ea6478"
Jul 28 17:13:03.741327 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:03.741289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597d58bd-v7twc" event={"ID":"dbe52cc0-25a9-40fc-89f0-6d8a5c13d4fa","Type":"ContainerStarted","Data":"ea4fe8d6d1e5f3f3922d87e6163ec37332243a89483541652b361d98555ee903"}
Jul 28 17:13:04.456368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:04.456304    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt" podUID="2c857623-8420-44b0-baf7-775f1c8600c0" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 28 17:13:04.745433 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:04.745356    2579 generic.go:356] "Generic (PLEG): container finished" podID="2c857623-8420-44b0-baf7-775f1c8600c0" containerID="e128bad7deaa2585aec1ad17031ad5773d4298277e5990cf921f2cc32d74d694" exitCode=1
Jul 28 17:13:04.745433 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:04.745408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt" event={"ID":"2c857623-8420-44b0-baf7-775f1c8600c0","Type":"ContainerDied","Data":"e128bad7deaa2585aec1ad17031ad5773d4298277e5990cf921f2cc32d74d694"}
Jul 28 17:13:04.745870 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:04.745682    2579 scope.go:117] "RemoveContainer" containerID="e128bad7deaa2585aec1ad17031ad5773d4298277e5990cf921f2cc32d74d694"
Jul 28 17:13:05.749586 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:05.749548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt" event={"ID":"2c857623-8420-44b0-baf7-775f1c8600c0","Type":"ContainerStarted","Data":"4cb428f4d52097cd3110dea8ca5f8f4ef481365237ca296b9433c08722c14e97"}
Jul 28 17:13:05.750033 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:05.749825    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:13:05.750439 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:05.750421    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9879bc95-8wwbt"
Jul 28 17:13:06.578902 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:06.578857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:13:06.579086 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:06.579000    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 17:13:06.579086 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:06.579064    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs podName:985e10c3-b813-4d6c-a47e-889875e4eec2 nodeName:}" failed. No retries permitted until 2026-07-28 17:15:08.579045993 +0000 UTC m=+374.252998915 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs") pod "network-metrics-daemon-8tv92" (UID: "985e10c3-b813-4d6c-a47e-889875e4eec2") : secret "metrics-daemon-secret" not found
Jul 28 17:13:12.888238 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.888207    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l88sm"]
Jul 28 17:13:12.890026 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.890009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:12.895551 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.895523    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 17:13:12.895665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.895596    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 17:13:12.895730 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.895695    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 17:13:12.895788 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.895740    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:13:12.897066 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.897047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mk9d2\""
Jul 28 17:13:12.900417 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.900396    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 17:13:12.903325 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.903307    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l88sm"]
Jul 28 17:13:12.981205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.981177    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"]
Jul 28 17:13:12.983142 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.983126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:12.986048 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.986028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zzxfl\""
Jul 28 17:13:12.986048 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.986045    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 17:13:12.986222 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.986151    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 17:13:12.986657 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.986642    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:13:12.998244 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:12.998225    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"]
Jul 28 17:13:13.022780 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.022755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e808385e-50e9-44fc-8d50-a57dbca2dcd4-trusted-ca\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.022869 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.022795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpl6\" (UniqueName: \"kubernetes.io/projected/e808385e-50e9-44fc-8d50-a57dbca2dcd4-kube-api-access-5kpl6\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.022869 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.022817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e808385e-50e9-44fc-8d50-a57dbca2dcd4-config\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.022869 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.022835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e808385e-50e9-44fc-8d50-a57dbca2dcd4-serving-cert\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.123544 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.123519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e808385e-50e9-44fc-8d50-a57dbca2dcd4-trusted-ca\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.123718 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.123556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpl6\" (UniqueName: \"kubernetes.io/projected/e808385e-50e9-44fc-8d50-a57dbca2dcd4-kube-api-access-5kpl6\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.123718 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.123579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6lhx\" (UniqueName: \"kubernetes.io/projected/5bf1ec12-2a7b-41cd-9389-97bd45d60045-kube-api-access-n6lhx\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:13.123718 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.123605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e808385e-50e9-44fc-8d50-a57dbca2dcd4-config\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.123718 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.123651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e808385e-50e9-44fc-8d50-a57dbca2dcd4-serving-cert\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.123910 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.123780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:13.124253 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.124236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e808385e-50e9-44fc-8d50-a57dbca2dcd4-config\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.124336 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.124320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e808385e-50e9-44fc-8d50-a57dbca2dcd4-trusted-ca\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.125787 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.125768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e808385e-50e9-44fc-8d50-a57dbca2dcd4-serving-cert\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.135486 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.135467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpl6\" (UniqueName: \"kubernetes.io/projected/e808385e-50e9-44fc-8d50-a57dbca2dcd4-kube-api-access-5kpl6\") pod \"console-operator-584dcb6b54-l88sm\" (UID: \"e808385e-50e9-44fc-8d50-a57dbca2dcd4\") " pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.198612 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.198565    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:13.224781 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.224756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6lhx\" (UniqueName: \"kubernetes.io/projected/5bf1ec12-2a7b-41cd-9389-97bd45d60045-kube-api-access-n6lhx\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:13.224901 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.224791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:13.224901 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:13.224895    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:13:13.225017 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:13.224952    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls podName:5bf1ec12-2a7b-41cd-9389-97bd45d60045 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:13.724937406 +0000 UTC m=+259.398890328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls") pod "cluster-samples-operator-6748489656-82bj4" (UID: "5bf1ec12-2a7b-41cd-9389-97bd45d60045") : secret "samples-operator-tls" not found
Jul 28 17:13:13.234633 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.234296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6lhx\" (UniqueName: \"kubernetes.io/projected/5bf1ec12-2a7b-41cd-9389-97bd45d60045-kube-api-access-n6lhx\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:13.319193 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.319162    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l88sm"]
Jul 28 17:13:13.322046 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:13.322019    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode808385e_50e9_44fc_8d50_a57dbca2dcd4.slice/crio-baea4bae195f19b2ce8b667250aea8ea974e351b8ed25bcd29359309a4336d0b WatchSource:0}: Error finding container baea4bae195f19b2ce8b667250aea8ea974e351b8ed25bcd29359309a4336d0b: Status 404 returned error can't find the container with id baea4bae195f19b2ce8b667250aea8ea974e351b8ed25bcd29359309a4336d0b
Jul 28 17:13:13.728295 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.728253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:13.728491 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:13.728394    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:13:13.728491 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:13.728454    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls podName:5bf1ec12-2a7b-41cd-9389-97bd45d60045 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:14.728439349 +0000 UTC m=+260.402392272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls") pod "cluster-samples-operator-6748489656-82bj4" (UID: "5bf1ec12-2a7b-41cd-9389-97bd45d60045") : secret "samples-operator-tls" not found
Jul 28 17:13:13.774558 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:13.774527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" event={"ID":"e808385e-50e9-44fc-8d50-a57dbca2dcd4","Type":"ContainerStarted","Data":"baea4bae195f19b2ce8b667250aea8ea974e351b8ed25bcd29359309a4336d0b"}
Jul 28 17:13:14.735903 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:14.735870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:14.736297 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:14.735978    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:13:14.736297 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:14.736025    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls podName:5bf1ec12-2a7b-41cd-9389-97bd45d60045 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:16.736013029 +0000 UTC m=+262.409965951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls") pod "cluster-samples-operator-6748489656-82bj4" (UID: "5bf1ec12-2a7b-41cd-9389-97bd45d60045") : secret "samples-operator-tls" not found
Jul 28 17:13:15.781975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:15.781947    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/0.log"
Jul 28 17:13:15.782378 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:15.781992    2579 generic.go:356] "Generic (PLEG): container finished" podID="e808385e-50e9-44fc-8d50-a57dbca2dcd4" containerID="bb920e274436a01f54abee85c174f8f7e2732f0881a641c0b5898273c4d0d5f6" exitCode=255
Jul 28 17:13:15.782378 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:15.782067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" event={"ID":"e808385e-50e9-44fc-8d50-a57dbca2dcd4","Type":"ContainerDied","Data":"bb920e274436a01f54abee85c174f8f7e2732f0881a641c0b5898273c4d0d5f6"}
Jul 28 17:13:15.782378 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:15.782220    2579 scope.go:117] "RemoveContainer" containerID="bb920e274436a01f54abee85c174f8f7e2732f0881a641c0b5898273c4d0d5f6"
Jul 28 17:13:16.748557 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.748486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:16.748679 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:16.748636    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:13:16.748713 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:16.748695    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls podName:5bf1ec12-2a7b-41cd-9389-97bd45d60045 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:20.748681955 +0000 UTC m=+266.422634879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls") pod "cluster-samples-operator-6748489656-82bj4" (UID: "5bf1ec12-2a7b-41cd-9389-97bd45d60045") : secret "samples-operator-tls" not found
Jul 28 17:13:16.785933 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.785910    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/1.log"
Jul 28 17:13:16.786369 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.786311    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/0.log"
Jul 28 17:13:16.786369 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.786351    2579 generic.go:356] "Generic (PLEG): container finished" podID="e808385e-50e9-44fc-8d50-a57dbca2dcd4" containerID="0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb" exitCode=255
Jul 28 17:13:16.786465 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.786379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" event={"ID":"e808385e-50e9-44fc-8d50-a57dbca2dcd4","Type":"ContainerDied","Data":"0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb"}
Jul 28 17:13:16.786465 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.786447    2579 scope.go:117] "RemoveContainer" containerID="bb920e274436a01f54abee85c174f8f7e2732f0881a641c0b5898273c4d0d5f6"
Jul 28 17:13:16.786617 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:16.786598    2579 scope.go:117] "RemoveContainer" containerID="0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb"
Jul 28 17:13:16.786768 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:16.786745    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l88sm_openshift-console-operator(e808385e-50e9-44fc-8d50-a57dbca2dcd4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4"
Jul 28 17:13:17.790859 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:17.790830    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/1.log"
Jul 28 17:13:17.791231 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:17.791113    2579 scope.go:117] "RemoveContainer" containerID="0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb"
Jul 28 17:13:17.791292 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:17.791244    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l88sm_openshift-console-operator(e808385e-50e9-44fc-8d50-a57dbca2dcd4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4"
Jul 28 17:13:18.014128 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.014100    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"]
Jul 28 17:13:18.016682 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.016667    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"
Jul 28 17:13:18.019513 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.019490    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 17:13:18.019513 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.019490    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 17:13:18.019703 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.019515    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9b889\""
Jul 28 17:13:18.025983 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.025966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"]
Jul 28 17:13:18.137305 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.137279    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5pxbc"]
Jul 28 17:13:18.139236 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.139222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.142313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.142293    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 17:13:18.142554 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.142525    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 17:13:18.142650 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.142620    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 17:13:18.142650 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.142637    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 17:13:18.143159 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.143146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hktz8\""
Jul 28 17:13:18.152218 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.152194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5pxbc"]
Jul 28 17:13:18.158751 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.158730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckcds\" (UniqueName: \"kubernetes.io/projected/87bbf73b-0e1f-4545-a24e-4b15f531d999-kube-api-access-ckcds\") pod \"migrator-6865c9967-8c9nl\" (UID: \"87bbf73b-0e1f-4545-a24e-4b15f531d999\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"
Jul 28 17:13:18.259166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.259135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khv4\" (UniqueName: \"kubernetes.io/projected/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-api-access-7khv4\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.259166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.259168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.259422 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.259188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckcds\" (UniqueName: \"kubernetes.io/projected/87bbf73b-0e1f-4545-a24e-4b15f531d999-kube-api-access-ckcds\") pod \"migrator-6865c9967-8c9nl\" (UID: \"87bbf73b-0e1f-4545-a24e-4b15f531d999\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"
Jul 28 17:13:18.259422 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.259206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.259422 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.259339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d90c577-1ad2-4844-ac06-f97ca197b9b4-data-volume\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.259422 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.259358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d90c577-1ad2-4844-ac06-f97ca197b9b4-crio-socket\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.267492 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.267473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckcds\" (UniqueName: \"kubernetes.io/projected/87bbf73b-0e1f-4545-a24e-4b15f531d999-kube-api-access-ckcds\") pod \"migrator-6865c9967-8c9nl\" (UID: \"87bbf73b-0e1f-4545-a24e-4b15f531d999\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"
Jul 28 17:13:18.325488 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.325468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"
Jul 28 17:13:18.359714 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.359686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.359844 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.359721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.359844 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.359740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d90c577-1ad2-4844-ac06-f97ca197b9b4-data-volume\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.359844 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.359759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d90c577-1ad2-4844-ac06-f97ca197b9b4-crio-socket\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.359844 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.359825    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:13:18.360063 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.359842    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:18.360063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.359857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khv4\" (UniqueName: \"kubernetes.io/projected/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-api-access-7khv4\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.360063 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.359902    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:18.859882066 +0000 UTC m=+264.533835008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : configmap "kube-rbac-proxy" not found
Jul 28 17:13:18.360063 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.359912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d90c577-1ad2-4844-ac06-f97ca197b9b4-crio-socket\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.360063 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.359923    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:18.859913581 +0000 UTC m=+264.533866525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:18.360332 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.360071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d90c577-1ad2-4844-ac06-f97ca197b9b4-data-volume\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.369877 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.369688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khv4\" (UniqueName: \"kubernetes.io/projected/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-api-access-7khv4\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.445598 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.445568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl"]
Jul 28 17:13:18.448664 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:18.448630    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bbf73b_0e1f_4545_a24e_4b15f531d999.slice/crio-2b15c8b66ddba1963ede1842e42441ac001a93ea8c005e7f9a2a7df20b79977f WatchSource:0}: Error finding container 2b15c8b66ddba1963ede1842e42441ac001a93ea8c005e7f9a2a7df20b79977f: Status 404 returned error can't find the container with id 2b15c8b66ddba1963ede1842e42441ac001a93ea8c005e7f9a2a7df20b79977f
Jul 28 17:13:18.794398 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.794318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl" event={"ID":"87bbf73b-0e1f-4545-a24e-4b15f531d999","Type":"ContainerStarted","Data":"2b15c8b66ddba1963ede1842e42441ac001a93ea8c005e7f9a2a7df20b79977f"}
Jul 28 17:13:18.863711 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.863682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.863865 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:18.863780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:18.863865 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.863854    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:18.863971 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.863863    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:13:18.864055 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.864040    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:19.863906649 +0000 UTC m=+265.537859574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:18.864114 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:18.864068    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:19.864055397 +0000 UTC m=+265.538008321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : configmap "kube-rbac-proxy" not found
Jul 28 17:13:19.799140 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:19.799053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl" event={"ID":"87bbf73b-0e1f-4545-a24e-4b15f531d999","Type":"ContainerStarted","Data":"920be33c3f3a902257c115f82f435b83a1b3dd69d01af7fa5d4ad2f427ae09ac"}
Jul 28 17:13:19.799140 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:19.799121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl" event={"ID":"87bbf73b-0e1f-4545-a24e-4b15f531d999","Type":"ContainerStarted","Data":"54b1deea4b39e1ef16b09f4d6c4b452ecab01cd3d7c800e57b4d7f470d5307f3"}
Jul 28 17:13:19.816420 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:19.816372    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8c9nl" podStartSLOduration=1.809375569 podStartE2EDuration="2.816354944s" totalImagesPullingTime="1.006979375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:19.816156633 +0000 UTC m=+265.490109579" watchObservedRunningTime="2026-07-28 17:13:19.816354944 +0000 UTC m=+265.490307890"
Jul 28 17:13:19.871160 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:19.871134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:19.871287 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:19.871169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:19.871287 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:19.871245    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:13:19.871353 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:19.871310    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:19.871353 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:19.871320    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:21.871306415 +0000 UTC m=+267.545259337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : configmap "kube-rbac-proxy" not found
Jul 28 17:13:19.871425 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:19.871362    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:21.871338319 +0000 UTC m=+267.545291242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:20.233755 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.233726    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rk4bm"]
Jul 28 17:13:20.235738 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.235724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.238621 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.238599    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 17:13:20.238738 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.238671    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 17:13:20.238738 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.238683    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 17:13:20.238738 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.238732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 17:13:20.240145 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.240128    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9f5n5\""
Jul 28 17:13:20.246566 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.246546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rk4bm"]
Jul 28 17:13:20.375279 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.375240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb52311e-03c0-4a36-b233-4c05761782bf-signing-key\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.375456 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.375307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb52311e-03c0-4a36-b233-4c05761782bf-signing-cabundle\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.375456 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.375389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rsdl\" (UniqueName: \"kubernetes.io/projected/bb52311e-03c0-4a36-b233-4c05761782bf-kube-api-access-7rsdl\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.476028 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.476000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb52311e-03c0-4a36-b233-4c05761782bf-signing-key\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.476100 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.476040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb52311e-03c0-4a36-b233-4c05761782bf-signing-cabundle\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.476144 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.476109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rsdl\" (UniqueName: \"kubernetes.io/projected/bb52311e-03c0-4a36-b233-4c05761782bf-kube-api-access-7rsdl\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.476623 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.476606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb52311e-03c0-4a36-b233-4c05761782bf-signing-cabundle\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.478526 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.478505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb52311e-03c0-4a36-b233-4c05761782bf-signing-key\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.485379 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.485333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rsdl\" (UniqueName: \"kubernetes.io/projected/bb52311e-03c0-4a36-b233-4c05761782bf-kube-api-access-7rsdl\") pod \"service-ca-658d7b7c78-rk4bm\" (UID: \"bb52311e-03c0-4a36-b233-4c05761782bf\") " pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.543917 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.543897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm"
Jul 28 17:13:20.660969 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.660942    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rk4bm"]
Jul 28 17:13:20.663480 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:20.663452    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb52311e_03c0_4a36_b233_4c05761782bf.slice/crio-105b7a1771f06b922abd0e00305baeb25ccb52b4871ea3a6d084c3bbeb936aa6 WatchSource:0}: Error finding container 105b7a1771f06b922abd0e00305baeb25ccb52b4871ea3a6d084c3bbeb936aa6: Status 404 returned error can't find the container with id 105b7a1771f06b922abd0e00305baeb25ccb52b4871ea3a6d084c3bbeb936aa6
Jul 28 17:13:20.778094 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.778021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:20.778094 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:20.778060    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:13:20.778322 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:20.778117    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls podName:5bf1ec12-2a7b-41cd-9389-97bd45d60045 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:28.778104141 +0000 UTC m=+274.452057064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls") pod "cluster-samples-operator-6748489656-82bj4" (UID: "5bf1ec12-2a7b-41cd-9389-97bd45d60045") : secret "samples-operator-tls" not found
Jul 28 17:13:20.803097 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:20.803069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm" event={"ID":"bb52311e-03c0-4a36-b233-4c05761782bf","Type":"ContainerStarted","Data":"105b7a1771f06b922abd0e00305baeb25ccb52b4871ea3a6d084c3bbeb936aa6"}
Jul 28 17:13:21.112670 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:21.112644    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sg74h_80a6a903-ef6e-4fa0-98e6-bcc0d4d31380/dns-node-resolver/0.log"
Jul 28 17:13:21.885634 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:21.885595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:21.885634 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:21.885636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:21.886093 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:21.885715    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:13:21.886093 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:21.885734    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:21.886093 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:21.885789    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:25.885769473 +0000 UTC m=+271.559722399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : configmap "kube-rbac-proxy" not found
Jul 28 17:13:21.886093 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:21.885840    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:25.885828613 +0000 UTC m=+271.559781536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:22.111799 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:22.111775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnblw_b4b56a44-32e8-42a4-a100-7b99e718331c/node-ca/0.log"
Jul 28 17:13:22.810677 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:22.810589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm" event={"ID":"bb52311e-03c0-4a36-b233-4c05761782bf","Type":"ContainerStarted","Data":"a30aed8c4f7675f0aec14c0826085f7a59a01862ea9e5c6c8f82bc6b64f35496"}
Jul 28 17:13:22.828380 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:22.828332    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-rk4bm" podStartSLOduration=0.967215299 podStartE2EDuration="2.828314317s" totalImagesPullingTime="1.861099018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:22.826193452 +0000 UTC m=+268.500146398" watchObservedRunningTime="2026-07-28 17:13:22.828314317 +0000 UTC m=+268.502267264"
Jul 28 17:13:22.912010 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:22.911981    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6h6x_4eddd939-47d2-458e-a0c1-0c4ade7a74fc/serve-healthcheck-canary/0.log"
Jul 28 17:13:23.113035 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:23.113002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8c9nl_87bbf73b-0e1f-4545-a24e-4b15f531d999/migrator/0.log"
Jul 28 17:13:23.199403 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:23.199370    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:23.199563 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:23.199438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:23.199842 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:23.199830    2579 scope.go:117] "RemoveContainer" containerID="0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb"
Jul 28 17:13:23.200018 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:23.199996    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l88sm_openshift-console-operator(e808385e-50e9-44fc-8d50-a57dbca2dcd4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4"
Jul 28 17:13:23.312289 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:23.312242    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8c9nl_87bbf73b-0e1f-4545-a24e-4b15f531d999/graceful-termination/0.log"
Jul 28 17:13:25.921654 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:25.921619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:25.921654 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:25.921664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:25.922184 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:25.921760    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:13:25.922184 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:25.921776    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:25.922184 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:25.921828    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:33.921811883 +0000 UTC m=+279.595764807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : configmap "kube-rbac-proxy" not found
Jul 28 17:13:25.922184 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:25.921842    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls podName:0d90c577-1ad2-4844-ac06-f97ca197b9b4 nodeName:}" failed. No retries permitted until 2026-07-28 17:13:33.921836358 +0000 UTC m=+279.595789281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5pxbc" (UID: "0d90c577-1ad2-4844-ac06-f97ca197b9b4") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:13:28.843669 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:28.843632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:28.845956 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:28.845936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bf1ec12-2a7b-41cd-9389-97bd45d60045-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-82bj4\" (UID: \"5bf1ec12-2a7b-41cd-9389-97bd45d60045\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:28.891780 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:28.891757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"
Jul 28 17:13:29.022235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:29.022211    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4"]
Jul 28 17:13:29.835973 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:29.835933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4" event={"ID":"5bf1ec12-2a7b-41cd-9389-97bd45d60045","Type":"ContainerStarted","Data":"70f25345f579c0cbc98ea4d88356cf5ef0720cfb079614f6fd2de7737a35cc00"}
Jul 28 17:13:30.841851 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:30.841817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4" event={"ID":"5bf1ec12-2a7b-41cd-9389-97bd45d60045","Type":"ContainerStarted","Data":"99fc92b77b0c062ff98aa97b59201837def1e37f35c98adb620cacdb274b0a72"}
Jul 28 17:13:30.842290 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:30.841875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4" event={"ID":"5bf1ec12-2a7b-41cd-9389-97bd45d60045","Type":"ContainerStarted","Data":"e956f3d48ee2986a7648f8dc3cece4397b0397e7e561e0e1abf9356500e4f37f"}
Jul 28 17:13:30.861673 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:30.861591    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-82bj4" podStartSLOduration=17.312847346 podStartE2EDuration="18.861575114s" totalImagesPullingTime="1.548727768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:30.860349482 +0000 UTC m=+276.534302427" watchObservedRunningTime="2026-07-28 17:13:30.861575114 +0000 UTC m=+276.535528058"
Jul 28 17:13:33.983685 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:33.983646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:33.984175 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:33.983700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:33.984235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:33.984216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d90c577-1ad2-4844-ac06-f97ca197b9b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:33.985944 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:33.985927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d90c577-1ad2-4844-ac06-f97ca197b9b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5pxbc\" (UID: \"0d90c577-1ad2-4844-ac06-f97ca197b9b4\") " pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:34.047479 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:34.047440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5pxbc"
Jul 28 17:13:34.177430 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:34.177403    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5pxbc"]
Jul 28 17:13:34.180603 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:34.180578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d90c577_1ad2_4844_ac06_f97ca197b9b4.slice/crio-389e6344b02a5ce537dada456bf4cd39e0a33a54c42bea0db43d84a139db29f9 WatchSource:0}: Error finding container 389e6344b02a5ce537dada456bf4cd39e0a33a54c42bea0db43d84a139db29f9: Status 404 returned error can't find the container with id 389e6344b02a5ce537dada456bf4cd39e0a33a54c42bea0db43d84a139db29f9
Jul 28 17:13:34.858454 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:34.858362    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pxbc" event={"ID":"0d90c577-1ad2-4844-ac06-f97ca197b9b4","Type":"ContainerStarted","Data":"389e6344b02a5ce537dada456bf4cd39e0a33a54c42bea0db43d84a139db29f9"}
Jul 28 17:13:37.525800 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:37.525763    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wbvtz" podUID="3e9b89fb-70f1-4b81-8d31-53971f2e18a0"
Jul 28 17:13:37.868975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:37.868945    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:13:38.927078 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:38.927057    2579 scope.go:117] "RemoveContainer" containerID="0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb"
Jul 28 17:13:39.881208 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.881182    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:13:39.881895 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.881878    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/1.log"
Jul 28 17:13:39.882002 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.881951    2579 generic.go:356] "Generic (PLEG): container finished" podID="e808385e-50e9-44fc-8d50-a57dbca2dcd4" containerID="f7f28323a4617a9424c9dca5cf16e09cdee5f2004ff79e7bb6d5e27523f70680" exitCode=255
Jul 28 17:13:39.882080 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.882042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" event={"ID":"e808385e-50e9-44fc-8d50-a57dbca2dcd4","Type":"ContainerDied","Data":"f7f28323a4617a9424c9dca5cf16e09cdee5f2004ff79e7bb6d5e27523f70680"}
Jul 28 17:13:39.882320 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.882300    2579 scope.go:117] "RemoveContainer" containerID="0f9a90a941e5a1bf9a4aadccb6aefc4b392f03630be348825152057e68ea3fdb"
Jul 28 17:13:39.883360 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.882742    2579 scope.go:117] "RemoveContainer" containerID="f7f28323a4617a9424c9dca5cf16e09cdee5f2004ff79e7bb6d5e27523f70680"
Jul 28 17:13:39.883360 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:39.882920    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-l88sm_openshift-console-operator(e808385e-50e9-44fc-8d50-a57dbca2dcd4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4"
Jul 28 17:13:39.884037 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:39.883760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pxbc" event={"ID":"0d90c577-1ad2-4844-ac06-f97ca197b9b4","Type":"ContainerStarted","Data":"382c19fadde99b0e49e70a4d12af67b881459e12d3fb0296c341b1f17762762e"}
Jul 28 17:13:40.635576 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:40.635541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:13:40.638032 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:40.638000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e9b89fb-70f1-4b81-8d31-53971f2e18a0-metrics-tls\") pod \"dns-default-wbvtz\" (UID: \"3e9b89fb-70f1-4b81-8d31-53971f2e18a0\") " pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:13:40.872884 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:40.872848    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zj6nk\""
Jul 28 17:13:40.880349 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:40.880321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:13:40.889176 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:40.889157    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:13:42.342898 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:42.342874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wbvtz"]
Jul 28 17:13:42.346698 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:42.346671    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9b89fb_70f1_4b81_8d31_53971f2e18a0.slice/crio-32fa4c7a96926dbb0a16768f3b030ff454af1482bc4f01d5b36de12659e96bf1 WatchSource:0}: Error finding container 32fa4c7a96926dbb0a16768f3b030ff454af1482bc4f01d5b36de12659e96bf1: Status 404 returned error can't find the container with id 32fa4c7a96926dbb0a16768f3b030ff454af1482bc4f01d5b36de12659e96bf1
Jul 28 17:13:42.898548 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:42.898507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pxbc" event={"ID":"0d90c577-1ad2-4844-ac06-f97ca197b9b4","Type":"ContainerStarted","Data":"d57cc148b08c1aaf2cbb0f6a9248a697a387db6fa49538a296f28be31a572a40"}
Jul 28 17:13:42.899858 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:42.899824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wbvtz" event={"ID":"3e9b89fb-70f1-4b81-8d31-53971f2e18a0","Type":"ContainerStarted","Data":"32fa4c7a96926dbb0a16768f3b030ff454af1482bc4f01d5b36de12659e96bf1"}
Jul 28 17:13:43.199625 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:43.199535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:43.199625 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:43.199616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:13:43.200029 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:43.200005    2579 scope.go:117] "RemoveContainer" containerID="f7f28323a4617a9424c9dca5cf16e09cdee5f2004ff79e7bb6d5e27523f70680"
Jul 28 17:13:43.200243 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:43.200213    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-l88sm_openshift-console-operator(e808385e-50e9-44fc-8d50-a57dbca2dcd4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4"
Jul 28 17:13:44.909795 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:44.909766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wbvtz" event={"ID":"3e9b89fb-70f1-4b81-8d31-53971f2e18a0","Type":"ContainerStarted","Data":"8bc59443e1e4c7a15c39b3f99fab1ac802aee298ab703fbf8117d4012f29937e"}
Jul 28 17:13:46.916891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:46.916856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5pxbc" event={"ID":"0d90c577-1ad2-4844-ac06-f97ca197b9b4","Type":"ContainerStarted","Data":"ad9da0e250ccd6b4ac718b5f178075150f0d2701b3aa1a2347a7407bf8a2857e"}
Jul 28 17:13:46.918483 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:46.918454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wbvtz" event={"ID":"3e9b89fb-70f1-4b81-8d31-53971f2e18a0","Type":"ContainerStarted","Data":"74175283547ecffe3ef62cbf10df62a433ae4d9f2602071eea660010822b368a"}
Jul 28 17:13:46.918620 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:46.918578    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:13:46.939006 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:46.938955    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5pxbc" podStartSLOduration=17.359857482 podStartE2EDuration="28.938942116s" totalImagesPullingTime="11.579084634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:13:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:46.937356611 +0000 UTC m=+292.611309555" watchObservedRunningTime="2026-07-28 17:13:46.938942116 +0000 UTC m=+292.612895060"
Jul 28 17:13:46.954250 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:46.954205    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wbvtz" podStartSLOduration=255.158230465 podStartE2EDuration="4m16.954193367s" totalImagesPullingTime="1.795962902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:46.954034419 +0000 UTC m=+292.627987363" watchObservedRunningTime="2026-07-28 17:13:46.954193367 +0000 UTC m=+292.628146313"
Jul 28 17:13:48.830798 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:48.830765    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"]
Jul 28 17:13:48.834796 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:48.834778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:48.837828 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:48.837805    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 17:13:48.837939 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:48.837814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mdsxb\""
Jul 28 17:13:48.844985 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:48.844967    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"]
Jul 28 17:13:48.899639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:48.899599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea2a9a70-f33b-44d4-82db-6c2b4eedc40b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-d52nt\" (UID: \"ea2a9a70-f33b-44d4-82db-6c2b4eedc40b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:48.927734 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:48.927701    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8tv92" podUID="985e10c3-b813-4d6c-a47e-889875e4eec2"
Jul 28 17:13:49.000366 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:49.000331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea2a9a70-f33b-44d4-82db-6c2b4eedc40b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-d52nt\" (UID: \"ea2a9a70-f33b-44d4-82db-6c2b4eedc40b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:49.000526 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:49.000435    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 17:13:49.000526 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:49.000485    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2a9a70-f33b-44d4-82db-6c2b4eedc40b-tls-certificates podName:ea2a9a70-f33b-44d4-82db-6c2b4eedc40b nodeName:}" failed. No retries permitted until 2026-07-28 17:13:49.500472251 +0000 UTC m=+295.174425175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ea2a9a70-f33b-44d4-82db-6c2b4eedc40b-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-d52nt" (UID: "ea2a9a70-f33b-44d4-82db-6c2b4eedc40b") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 17:13:49.504539 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:49.504508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea2a9a70-f33b-44d4-82db-6c2b4eedc40b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-d52nt\" (UID: \"ea2a9a70-f33b-44d4-82db-6c2b4eedc40b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:49.506844 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:49.506825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ea2a9a70-f33b-44d4-82db-6c2b4eedc40b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-d52nt\" (UID: \"ea2a9a70-f33b-44d4-82db-6c2b4eedc40b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:49.744392 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:49.744360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:49.872629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:49.872592    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"]
Jul 28 17:13:49.876177 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:49.876154    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2a9a70_f33b_44d4_82db_6c2b4eedc40b.slice/crio-3308d3387edfb9cc7c0202da01d2fc1cd6e2213ce31267dac1b16f56839c8f31 WatchSource:0}: Error finding container 3308d3387edfb9cc7c0202da01d2fc1cd6e2213ce31267dac1b16f56839c8f31: Status 404 returned error can't find the container with id 3308d3387edfb9cc7c0202da01d2fc1cd6e2213ce31267dac1b16f56839c8f31
Jul 28 17:13:49.928676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:49.928644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt" event={"ID":"ea2a9a70-f33b-44d4-82db-6c2b4eedc40b","Type":"ContainerStarted","Data":"3308d3387edfb9cc7c0202da01d2fc1cd6e2213ce31267dac1b16f56839c8f31"}
Jul 28 17:13:51.935750 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:51.935718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt" event={"ID":"ea2a9a70-f33b-44d4-82db-6c2b4eedc40b","Type":"ContainerStarted","Data":"6834c38274550d525a26ab7e07f07cc72dfae3140c85c1dbe3bfd170b803b455"}
Jul 28 17:13:51.936174 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:51.935940    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:51.940756 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:51.940738    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt"
Jul 28 17:13:51.954443 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:51.954400    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-d52nt" podStartSLOduration=2.9511969970000003 podStartE2EDuration="3.954386781s" totalImagesPullingTime="1.003189784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:51.953296476 +0000 UTC m=+297.627249419" watchObservedRunningTime="2026-07-28 17:13:51.954386781 +0000 UTC m=+297.628339725"
Jul 28 17:13:54.752064 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:54.752033    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:13:54.753713 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:54.753690    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:13:54.762053 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:54.762037    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 17:13:54.928692 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:54.928554    2579 scope.go:117] "RemoveContainer" containerID="f7f28323a4617a9424c9dca5cf16e09cdee5f2004ff79e7bb6d5e27523f70680"
Jul 28 17:13:54.939766 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:13:54.928716    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-l88sm_openshift-console-operator(e808385e-50e9-44fc-8d50-a57dbca2dcd4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4"
Jul 28 17:13:56.923555 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:56.923527    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wbvtz"
Jul 28 17:13:57.408285 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.408247    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zzpnf"]
Jul 28 17:13:57.411599 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.411573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.414598 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.414573    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 17:13:57.414928 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.414907    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 17:13:57.415013 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.414936    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zd2gj\""
Jul 28 17:13:57.415073 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.415032    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 17:13:57.415875 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.415856    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 17:13:57.415970 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.415891    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 17:13:57.415970 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.415915    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 17:13:57.464647 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-root\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-tls\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-sys\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-wtmp\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464981 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-metrics-client-ca\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464981 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87pg\" (UniqueName: \"kubernetes.io/projected/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-kube-api-access-b87pg\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464981 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.464981 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.464963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-textfile\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.565950 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.565910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-tls\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566143 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.565957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-sys\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566143 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.565982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-wtmp\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566143 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-sys\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566143 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-wtmp\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566361 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566361 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-metrics-client-ca\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566361 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87pg\" (UniqueName: \"kubernetes.io/projected/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-kube-api-access-b87pg\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566361 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-textfile\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-root\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-root\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.566895 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.567071 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.566977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-textfile\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.567204 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.567184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-metrics-client-ca\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.568736 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.568717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.568966 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.568945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-node-exporter-tls\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.578913 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.578889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87pg\" (UniqueName: \"kubernetes.io/projected/f2f4f300-bc6f-469f-8b58-59e0c05e87ee-kube-api-access-b87pg\") pod \"node-exporter-zzpnf\" (UID: \"f2f4f300-bc6f-469f-8b58-59e0c05e87ee\") " pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.721134 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.721059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzpnf"
Jul 28 17:13:57.731625 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:57.731592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f4f300_bc6f_469f_8b58_59e0c05e87ee.slice/crio-03beba34e11ea34c78c1e29ae1dc27729770e1f7a87a36409e4d2594071e30c6 WatchSource:0}: Error finding container 03beba34e11ea34c78c1e29ae1dc27729770e1f7a87a36409e4d2594071e30c6: Status 404 returned error can't find the container with id 03beba34e11ea34c78c1e29ae1dc27729770e1f7a87a36409e4d2594071e30c6
Jul 28 17:13:57.733600 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.733584    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:13:57.954814 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:57.954782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzpnf" event={"ID":"f2f4f300-bc6f-469f-8b58-59e0c05e87ee","Type":"ContainerStarted","Data":"03beba34e11ea34c78c1e29ae1dc27729770e1f7a87a36409e4d2594071e30c6"}
Jul 28 17:13:58.653734 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.653704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:13:58.657860 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.657838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.660943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.660923    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 17:13:58.661049 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.660997    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 17:13:58.661049 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 17:13:58.661049 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661001    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8xh4b\""
Jul 28 17:13:58.661235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 17:13:58.661235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661071    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 17:13:58.661235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 17:13:58.661470 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 17:13:58.661533 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661516    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 17:13:58.661642 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.661627    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 17:13:58.679778 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.679756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:13:58.776345 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2j8p\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-kube-api-access-c2j8p\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776345 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776345 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-tls-assets\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-web-config\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-config-volume\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776770 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-config-out\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776770 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776770 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.776770 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.776684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.877818 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2j8p\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-kube-api-access-c2j8p\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.877818 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-tls-assets\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.877989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-web-config\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.878014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-config-volume\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.878045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-config-out\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.878065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878556 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.878104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878556 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.878141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.878729 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.878682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.879306 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.879228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.879555 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.879527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.880904 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.880876    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-tls-assets\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.881007 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.880993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.881111 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.881090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-config-out\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.881650 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.881624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-web-config\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.881731 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.881679    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.881991 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.881971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.882066 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.882046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-config-volume\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.882461 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.882441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.882810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.882793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.888432 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.888412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2j8p\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-kube-api-access-c2j8p\") pod \"alertmanager-main-0\" (UID: \"900126f9-3524-4749-958f-681382d31027\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:58.959722 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.959688    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2f4f300-bc6f-469f-8b58-59e0c05e87ee" containerID="93a05710ff53488935cae25c0e3d8d7e8eef64b031cac93d8763c434b3c0fa9f" exitCode=0
Jul 28 17:13:58.960073 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:58.959740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzpnf" event={"ID":"f2f4f300-bc6f-469f-8b58-59e0c05e87ee","Type":"ContainerDied","Data":"93a05710ff53488935cae25c0e3d8d7e8eef64b031cac93d8763c434b3c0fa9f"}
Jul 28 17:13:59.018629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.018606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:13:59.173235 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.173194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:13:59.177781 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:13:59.177748    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900126f9_3524_4749_958f_681382d31027.slice/crio-d8b2f7dcd384fb32033f77501942204bf46582da18ba448872b04d5f85c378fa WatchSource:0}: Error finding container d8b2f7dcd384fb32033f77501942204bf46582da18ba448872b04d5f85c378fa: Status 404 returned error can't find the container with id d8b2f7dcd384fb32033f77501942204bf46582da18ba448872b04d5f85c378fa
Jul 28 17:13:59.503912 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.503882    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6845768684-qwkxl"]
Jul 28 17:13:59.507659 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.507642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.515121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.515095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 17:13:59.515371 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.515355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 17:13:59.515874 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.515850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 17:13:59.516198 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.515969    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 17:13:59.516555 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.516538    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-87cmb\""
Jul 28 17:13:59.516943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.516925    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 17:13:59.517225 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.517210    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4fl1k5u5pfdld\""
Jul 28 17:13:59.533397 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.533373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6845768684-qwkxl"]
Jul 28 17:13:59.582149 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582257 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-tls\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582257 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a871994-11ff-42da-bfa0-e7bbdbd89d95-metrics-client-ca\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582372 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq5jf\" (UniqueName: \"kubernetes.io/projected/8a871994-11ff-42da-bfa0-e7bbdbd89d95-kube-api-access-mq5jf\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582372 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582443 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582443 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-grpc-tls\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.582507 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.582463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683567 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683567 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-tls\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a871994-11ff-42da-bfa0-e7bbdbd89d95-metrics-client-ca\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq5jf\" (UniqueName: \"kubernetes.io/projected/8a871994-11ff-42da-bfa0-e7bbdbd89d95-kube-api-access-mq5jf\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-grpc-tls\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.683918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.683797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.684543 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.684493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a871994-11ff-42da-bfa0-e7bbdbd89d95-metrics-client-ca\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.686771 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.686747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-tls\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.686889 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.686747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.686889 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.686845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.687013 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.686968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.687532 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.687491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-grpc-tls\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.687532 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.687521    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a871994-11ff-42da-bfa0-e7bbdbd89d95-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.698386 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.698363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq5jf\" (UniqueName: \"kubernetes.io/projected/8a871994-11ff-42da-bfa0-e7bbdbd89d95-kube-api-access-mq5jf\") pod \"thanos-querier-6845768684-qwkxl\" (UID: \"8a871994-11ff-42da-bfa0-e7bbdbd89d95\") " pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.816691 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.816612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:13:59.965616 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.965524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6845768684-qwkxl"]
Jul 28 17:13:59.967494 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.967466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzpnf" event={"ID":"f2f4f300-bc6f-469f-8b58-59e0c05e87ee","Type":"ContainerStarted","Data":"b079e8e5ac7208bb9cd3b5bb5567da95bccd1ac811ddb16acbe9d4aa106beac3"}
Jul 28 17:13:59.967637 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.967519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzpnf" event={"ID":"f2f4f300-bc6f-469f-8b58-59e0c05e87ee","Type":"ContainerStarted","Data":"9d47b764d552908cbc8c3cfb37a0460b9bc06fde55ba291d1dcffb6198fbd517"}
Jul 28 17:13:59.968934 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.968909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"d8b2f7dcd384fb32033f77501942204bf46582da18ba448872b04d5f85c378fa"}
Jul 28 17:13:59.990477 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:13:59.990428    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zzpnf" podStartSLOduration=2.142300932 podStartE2EDuration="2.990409099s" totalImagesPullingTime="784.057729ms" totalInitContainerRuntime="64.050438ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:59.989712202 +0000 UTC m=+305.663665146" watchObservedRunningTime="2026-07-28 17:13:59.990409099 +0000 UTC m=+305.664362045"
Jul 28 17:14:00.120121 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:14:00.120088    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a871994_11ff_42da_bfa0_e7bbdbd89d95.slice/crio-a1a4a3d408a6f9d5bfb4326bbd9034472a6848866b10b2a6721223148c6bd7b6 WatchSource:0}: Error finding container a1a4a3d408a6f9d5bfb4326bbd9034472a6848866b10b2a6721223148c6bd7b6: Status 404 returned error can't find the container with id a1a4a3d408a6f9d5bfb4326bbd9034472a6848866b10b2a6721223148c6bd7b6
Jul 28 17:14:00.975933 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:00.975895    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2" exitCode=0
Jul 28 17:14:00.976354 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:00.975981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"}
Jul 28 17:14:00.977147 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:00.977129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"a1a4a3d408a6f9d5bfb4326bbd9034472a6848866b10b2a6721223148c6bd7b6"}
Jul 28 17:14:01.927047 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:01.927015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:14:02.990805 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.990773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"}
Jul 28 17:14:02.991205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.990879    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"}
Jul 28 17:14:02.991205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.990908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"}
Jul 28 17:14:02.991205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.990942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"}
Jul 28 17:14:02.991205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.990980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"}
Jul 28 17:14:02.992766 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.992742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"e3a20a227e1b71a39a52fd2c51f29e0fb617085941ca987cd2fd6f73e845200d"}
Jul 28 17:14:02.992873 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.992806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"0ea5f45bc518844b8f088d535eb0a331104d2a2cf280c3279ad0a62de6538ead"}
Jul 28 17:14:02.992931 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:02.992857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"3f3c84e37f836823464deaaf0c9eaf1ac1d3e1c6b4bd2c02738c474ea9b34cbc"}
Jul 28 17:14:03.999178 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:03.999146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"e0c8a70cd05f8608bc0d1ff75481f56fcd7139683b545d43bb5634d256de842f"}
Jul 28 17:14:03.999696 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:03.999216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"c5ebd6e476895ae0c06e817bc9546bba5befe7ebe48e0b71bb5fe1cb29da86ae"}
Jul 28 17:14:03.999696 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:03.999276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:14:03.999696 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:03.999329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" event={"ID":"8a871994-11ff-42da-bfa0-e7bbdbd89d95","Type":"ContainerStarted","Data":"0b21db252e08e94139fd19b42e740efcef18caed5a41f534ea68a336c8f7602c"}
Jul 28 17:14:04.002202 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:04.002178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerStarted","Data":"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"}
Jul 28 17:14:04.031086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:04.031040    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl" podStartSLOduration=1.775476149 podStartE2EDuration="5.031026506s" totalImagesPullingTime="3.255550357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:04.028894259 +0000 UTC m=+309.702847217" watchObservedRunningTime="2026-07-28 17:14:04.031026506 +0000 UTC m=+309.704979496"
Jul 28 17:14:04.063988 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:04.063942    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.772806533 podStartE2EDuration="6.063925651s" totalImagesPullingTime="3.273581307s" totalInitContainerRuntime="17.537811ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:04.061467176 +0000 UTC m=+309.735420119" watchObservedRunningTime="2026-07-28 17:14:04.063925651 +0000 UTC m=+309.737878595"
Jul 28 17:14:05.926626 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:05.926592    2579 scope.go:117] "RemoveContainer" containerID="f7f28323a4617a9424c9dca5cf16e09cdee5f2004ff79e7bb6d5e27523f70680"
Jul 28 17:14:06.014797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:06.014771    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:14:06.014928 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:06.014829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" event={"ID":"e808385e-50e9-44fc-8d50-a57dbca2dcd4","Type":"ContainerStarted","Data":"9d37fa7a4e23ac009bc5e4b18704f3023a0ff6b282de0dfd22d0e7bf65439c3f"}
Jul 28 17:14:06.015141 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:06.015114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:14:06.016658 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:06.016632    2579 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-l88sm container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.10:8443/readyz\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body=
Jul 28 17:14:06.016760 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:06.016677    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podUID="e808385e-50e9-44fc-8d50-a57dbca2dcd4" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.10:8443/readyz\": dial tcp 10.133.0.10:8443: connect: connection refused"
Jul 28 17:14:06.038351 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:06.038301    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm" podStartSLOduration=52.022533953 podStartE2EDuration="54.038283471s" totalImagesPullingTime="2.015749518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:06.037052585 +0000 UTC m=+311.711005531" watchObservedRunningTime="2026-07-28 17:14:06.038283471 +0000 UTC m=+311.712236413"
Jul 28 17:14:07.022169 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.022137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-l88sm"
Jul 28 17:14:07.097998 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.097968    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-h75c9"]
Jul 28 17:14:07.100360 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.100344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:07.103480 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.103463    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jkc7r\""
Jul 28 17:14:07.104112 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.104094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 17:14:07.104184 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.104132    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 17:14:07.112189 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.112145    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-h75c9"]
Jul 28 17:14:07.252403 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.252366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tz7g\" (UniqueName: \"kubernetes.io/projected/ebf6b172-1e75-4ea5-ab07-1fad5d50bc21-kube-api-access-9tz7g\") pod \"downloads-7c97dc4555-h75c9\" (UID: \"ebf6b172-1e75-4ea5-ab07-1fad5d50bc21\") " pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:07.353532 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.353503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tz7g\" (UniqueName: \"kubernetes.io/projected/ebf6b172-1e75-4ea5-ab07-1fad5d50bc21-kube-api-access-9tz7g\") pod \"downloads-7c97dc4555-h75c9\" (UID: \"ebf6b172-1e75-4ea5-ab07-1fad5d50bc21\") " pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:07.366590 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.366561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tz7g\" (UniqueName: \"kubernetes.io/projected/ebf6b172-1e75-4ea5-ab07-1fad5d50bc21-kube-api-access-9tz7g\") pod \"downloads-7c97dc4555-h75c9\" (UID: \"ebf6b172-1e75-4ea5-ab07-1fad5d50bc21\") " pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:07.409888 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.409857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:07.553675 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:07.553641    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-h75c9"]
Jul 28 17:14:07.557497 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:14:07.557470    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf6b172_1e75_4ea5_ab07_1fad5d50bc21.slice/crio-1af6241ccbd3cc11b47baeeee6323221a78ed71803d912d38cf8b0e66b64dadb WatchSource:0}: Error finding container 1af6241ccbd3cc11b47baeeee6323221a78ed71803d912d38cf8b0e66b64dadb: Status 404 returned error can't find the container with id 1af6241ccbd3cc11b47baeeee6323221a78ed71803d912d38cf8b0e66b64dadb
Jul 28 17:14:08.024207 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:08.024158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-h75c9" event={"ID":"ebf6b172-1e75-4ea5-ab07-1fad5d50bc21","Type":"ContainerStarted","Data":"1af6241ccbd3cc11b47baeeee6323221a78ed71803d912d38cf8b0e66b64dadb"}
Jul 28 17:14:10.012634 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:10.012605    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6845768684-qwkxl"
Jul 28 17:14:23.941200 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:23.941163    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/init-config-reloader/0.log"
Jul 28 17:14:24.093166 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.093123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-h75c9" event={"ID":"ebf6b172-1e75-4ea5-ab07-1fad5d50bc21","Type":"ContainerStarted","Data":"01d4d33299124854c97853875e7f93afda578c6c2d53f1c86f5e9269da865f0e"}
Jul 28 17:14:24.093371 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.093312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:24.099591 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.099557    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-h75c9"
Jul 28 17:14:24.117084 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.117023    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-h75c9" podStartSLOduration=1.353196666 podStartE2EDuration="17.117003808s" totalImagesPullingTime="15.763807142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:24.114914946 +0000 UTC m=+329.788867894" watchObservedRunningTime="2026-07-28 17:14:24.117003808 +0000 UTC m=+329.790956754"
Jul 28 17:14:24.139728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.139697    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/alertmanager/0.log"
Jul 28 17:14:24.336140 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.336058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/config-reloader/0.log"
Jul 28 17:14:24.536802 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.536767    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/kube-rbac-proxy-web/0.log"
Jul 28 17:14:24.735207 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.735175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/kube-rbac-proxy/0.log"
Jul 28 17:14:24.934963 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:24.934910    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/kube-rbac-proxy-metric/0.log"
Jul 28 17:14:25.134786 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:25.134750    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_900126f9-3524-4749-958f-681382d31027/prom-label-proxy/0.log"
Jul 28 17:14:27.735072 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:27.735037    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzpnf_f2f4f300-bc6f-469f-8b58-59e0c05e87ee/init-textfile/0.log"
Jul 28 17:14:27.935931 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:27.935900    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzpnf_f2f4f300-bc6f-469f-8b58-59e0c05e87ee/node-exporter/0.log"
Jul 28 17:14:28.135183 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:28.135156    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzpnf_f2f4f300-bc6f-469f-8b58-59e0c05e87ee/kube-rbac-proxy/0.log"
Jul 28 17:14:30.740539 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:30.740495    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-d52nt_ea2a9a70-f33b-44d4-82db-6c2b4eedc40b/prometheus-operator-admission-webhook/0.log"
Jul 28 17:14:31.535069 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:31.535039    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/thanos-query/0.log"
Jul 28 17:14:31.734804 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:31.734775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy-web/0.log"
Jul 28 17:14:31.935428 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:31.935398    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy/0.log"
Jul 28 17:14:32.137467 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:32.137443    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/prom-label-proxy/0.log"
Jul 28 17:14:32.334958 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:32.334885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy-rules/0.log"
Jul 28 17:14:32.534767 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:32.534726    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy-metrics/0.log"
Jul 28 17:14:32.934486 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:32.934460    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:14:33.135493 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:33.135464    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/3.log"
Jul 28 17:14:33.535710 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:33.535680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-h75c9_ebf6b172-1e75-4ea5-ab07-1fad5d50bc21/download-server/0.log"
Jul 28 17:14:34.537181 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:34.537155    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wbvtz_3e9b89fb-70f1-4b81-8d31-53971f2e18a0/dns/0.log"
Jul 28 17:14:34.734455 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:34.734428    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wbvtz_3e9b89fb-70f1-4b81-8d31-53971f2e18a0/kube-rbac-proxy/0.log"
Jul 28 17:14:35.337994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:14:35.337972    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sg74h_80a6a903-ef6e-4fa0-98e6-bcc0d4d31380/dns-node-resolver/0.log"
Jul 28 17:15:08.587715 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:08.587669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:15:08.589942 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:08.589920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985e10c3-b813-4d6c-a47e-889875e4eec2-metrics-certs\") pod \"network-metrics-daemon-8tv92\" (UID: \"985e10c3-b813-4d6c-a47e-889875e4eec2\") " pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:15:08.830779 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:08.830747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-24g9l\""
Jul 28 17:15:08.838144 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:08.838097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8tv92"
Jul 28 17:15:08.966113 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:08.965980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8tv92"]
Jul 28 17:15:08.968763 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:15:08.968738    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985e10c3_b813_4d6c_a47e_889875e4eec2.slice/crio-b6ab029974c0cdf1e1b437bc2452ccd6f585f88ef3adb3c122abcf5da0fb59b4 WatchSource:0}: Error finding container b6ab029974c0cdf1e1b437bc2452ccd6f585f88ef3adb3c122abcf5da0fb59b4: Status 404 returned error can't find the container with id b6ab029974c0cdf1e1b437bc2452ccd6f585f88ef3adb3c122abcf5da0fb59b4
Jul 28 17:15:09.265758 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:09.265722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tv92" event={"ID":"985e10c3-b813-4d6c-a47e-889875e4eec2","Type":"ContainerStarted","Data":"b6ab029974c0cdf1e1b437bc2452ccd6f585f88ef3adb3c122abcf5da0fb59b4"}
Jul 28 17:15:10.270728 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:10.270692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tv92" event={"ID":"985e10c3-b813-4d6c-a47e-889875e4eec2","Type":"ContainerStarted","Data":"e722c965fb0c2d1332e19aee2b61922cbb8d2bac57cbad44e3689fd38bef437a"}
Jul 28 17:15:10.271133 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:10.270744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8tv92" event={"ID":"985e10c3-b813-4d6c-a47e-889875e4eec2","Type":"ContainerStarted","Data":"5bc9960b5c1051cf206fbd4da7fad6e3d1be28ce28e003d22d14cf245c85ab7d"}
Jul 28 17:15:10.293631 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:10.293581    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8tv92" podStartSLOduration=374.521785193 podStartE2EDuration="6m15.293567254s" totalImagesPullingTime="771.782061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:15:10.293169877 +0000 UTC m=+375.967122823" watchObservedRunningTime="2026-07-28 17:15:10.293567254 +0000 UTC m=+375.967520196"
Jul 28 17:15:17.990485 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990449    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:15:17.990994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990725    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="900126f9-3524-4749-958f-681382d31027" containerName="alertmanager" containerID="cri-o://e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f" gracePeriod=120
Jul 28 17:15:17.990994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990791    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-metric" containerID="cri-o://579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421" gracePeriod=120
Jul 28 17:15:17.990994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990829    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-web" containerID="cri-o://baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599" gracePeriod=120
Jul 28 17:15:17.990994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990879    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="900126f9-3524-4749-958f-681382d31027" containerName="prom-label-proxy" containerID="cri-o://bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919" gracePeriod=120
Jul 28 17:15:17.990994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990862    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="900126f9-3524-4749-958f-681382d31027" containerName="config-reloader" containerID="cri-o://6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8" gracePeriod=120
Jul 28 17:15:17.990994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:17.990869    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy" containerID="cri-o://0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937" gracePeriod=120
Jul 28 17:15:18.307462 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307382    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919" exitCode=0
Jul 28 17:15:18.307462 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307407    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937" exitCode=0
Jul 28 17:15:18.307462 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307413    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8" exitCode=0
Jul 28 17:15:18.307462 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307420    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f" exitCode=0
Jul 28 17:15:18.307462 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"}
Jul 28 17:15:18.307715 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"}
Jul 28 17:15:18.307715 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"}
Jul 28 17:15:18.307715 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:18.307579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"}
Jul 28 17:15:19.238925 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.238901    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.264165 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264136    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-metrics-client-ca\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264165 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-alertmanager-main-db\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264187    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-web-config\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-config-out\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-metric\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264284    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-main-tls\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-tls-assets\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264338    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-cluster-tls-config\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264368 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2j8p\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-kube-api-access-c2j8p\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264410    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-alertmanager-trusted-ca-bundle\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264462    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-config-volume\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-web\") pod \"900126f9-3524-4749-958f-681382d31027\" (UID: \"900126f9-3524-4749-958f-681382d31027\") "
Jul 28 17:15:19.264702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:15:19.264702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264651    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:15:19.264999 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264841    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-metrics-client-ca\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.264999 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264863    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-alertmanager-main-db\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.264999 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.264859    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:15:19.267303 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.267259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.267660 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.267620    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-kube-api-access-c2j8p" (OuterVolumeSpecName: "kube-api-access-c2j8p") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "kube-api-access-c2j8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:15:19.267768 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.267674    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.267768 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.267694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.268015 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.267990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:15:19.268121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.268096    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-config-out" (OuterVolumeSpecName: "config-out") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:15:19.268121 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.268101    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.268238 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.268223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-config-volume" (OuterVolumeSpecName: "config-volume") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.272989 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.272955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.282981 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.282956    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-web-config" (OuterVolumeSpecName: "web-config") pod "900126f9-3524-4749-958f-681382d31027" (UID: "900126f9-3524-4749-958f-681382d31027"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:19.315444 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315356    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421" exitCode=0
Jul 28 17:15:19.315444 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315382    2579 generic.go:356] "Generic (PLEG): container finished" podID="900126f9-3524-4749-958f-681382d31027" containerID="baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599" exitCode=0
Jul 28 17:15:19.315444 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"}
Jul 28 17:15:19.315668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"}
Jul 28 17:15:19.315668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315437    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.315668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"900126f9-3524-4749-958f-681382d31027","Type":"ContainerDied","Data":"d8b2f7dcd384fb32033f77501942204bf46582da18ba448872b04d5f85c378fa"}
Jul 28 17:15:19.315668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.315592    2579 scope.go:117] "RemoveContainer" containerID="bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"
Jul 28 17:15:19.324176 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.324153    2579 scope.go:117] "RemoveContainer" containerID="579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"
Jul 28 17:15:19.331699 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.331681    2579 scope.go:117] "RemoveContainer" containerID="0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"
Jul 28 17:15:19.338143 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.338125    2579 scope.go:117] "RemoveContainer" containerID="baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"
Jul 28 17:15:19.344735 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.344708    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:15:19.345258 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.345246    2579 scope.go:117] "RemoveContainer" containerID="6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"
Jul 28 17:15:19.349541 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.349522    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:15:19.352536 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.352520    2579 scope.go:117] "RemoveContainer" containerID="e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"
Jul 28 17:15:19.359524 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.359503    2579 scope.go:117] "RemoveContainer" containerID="72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"
Jul 28 17:15:19.365834 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365807    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.365916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365838    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-main-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.365916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365857    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-tls-assets\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.365916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365872    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-cluster-tls-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.365916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365884    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2j8p\" (UniqueName: \"kubernetes.io/projected/900126f9-3524-4749-958f-681382d31027-kube-api-access-c2j8p\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.365916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365897    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900126f9-3524-4749-958f-681382d31027-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.365916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365911    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.366158 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365924    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-config-volume\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.366158 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365937    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.366158 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365977    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/900126f9-3524-4749-958f-681382d31027-web-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.366158 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.365991    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/900126f9-3524-4749-958f-681382d31027-config-out\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:15:19.366493 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.366230    2579 scope.go:117] "RemoveContainer" containerID="bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"
Jul 28 17:15:19.366525 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.366504    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919\": container with ID starting with bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919 not found: ID does not exist" containerID="bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"
Jul 28 17:15:19.366570 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.366530    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"} err="failed to get container status \"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919\": rpc error: code = NotFound desc = could not find container \"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919\": container with ID starting with bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919 not found: ID does not exist"
Jul 28 17:15:19.366624 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.366573    2579 scope.go:117] "RemoveContainer" containerID="579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"
Jul 28 17:15:19.366849 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.366829    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421\": container with ID starting with 579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421 not found: ID does not exist" containerID="579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"
Jul 28 17:15:19.366901 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.366858    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"} err="failed to get container status \"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421\": rpc error: code = NotFound desc = could not find container \"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421\": container with ID starting with 579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421 not found: ID does not exist"
Jul 28 17:15:19.366901 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.366881    2579 scope.go:117] "RemoveContainer" containerID="0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"
Jul 28 17:15:19.367107 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.367088    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937\": container with ID starting with 0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937 not found: ID does not exist" containerID="0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"
Jul 28 17:15:19.367148 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367112    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"} err="failed to get container status \"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937\": rpc error: code = NotFound desc = could not find container \"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937\": container with ID starting with 0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937 not found: ID does not exist"
Jul 28 17:15:19.367148 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367125    2579 scope.go:117] "RemoveContainer" containerID="baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"
Jul 28 17:15:19.367345 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.367327    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599\": container with ID starting with baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599 not found: ID does not exist" containerID="baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"
Jul 28 17:15:19.367388 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367351    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"} err="failed to get container status \"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599\": rpc error: code = NotFound desc = could not find container \"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599\": container with ID starting with baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599 not found: ID does not exist"
Jul 28 17:15:19.367388 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367363    2579 scope.go:117] "RemoveContainer" containerID="6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"
Jul 28 17:15:19.367568 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.367553    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8\": container with ID starting with 6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8 not found: ID does not exist" containerID="6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"
Jul 28 17:15:19.367605 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367572    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"} err="failed to get container status \"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8\": rpc error: code = NotFound desc = could not find container \"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8\": container with ID starting with 6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8 not found: ID does not exist"
Jul 28 17:15:19.367605 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367584    2579 scope.go:117] "RemoveContainer" containerID="e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"
Jul 28 17:15:19.367773 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.367757    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f\": container with ID starting with e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f not found: ID does not exist" containerID="e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"
Jul 28 17:15:19.367819 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367776    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"} err="failed to get container status \"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f\": rpc error: code = NotFound desc = could not find container \"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f\": container with ID starting with e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f not found: ID does not exist"
Jul 28 17:15:19.367819 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.367788    2579 scope.go:117] "RemoveContainer" containerID="72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"
Jul 28 17:15:19.368000 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:15:19.367981    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2\": container with ID starting with 72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2 not found: ID does not exist" containerID="72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"
Jul 28 17:15:19.368042 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368003    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"} err="failed to get container status \"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2\": rpc error: code = NotFound desc = could not find container \"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2\": container with ID starting with 72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2 not found: ID does not exist"
Jul 28 17:15:19.368042 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368014    2579 scope.go:117] "RemoveContainer" containerID="bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"
Jul 28 17:15:19.368208 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368192    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919"} err="failed to get container status \"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919\": rpc error: code = NotFound desc = could not find container \"bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919\": container with ID starting with bbbf2df44589126588c460159c1328aa4cf6e79e9dda3ca5c4ab0df2ac94f919 not found: ID does not exist"
Jul 28 17:15:19.368245 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368208    2579 scope.go:117] "RemoveContainer" containerID="579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"
Jul 28 17:15:19.368421 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368403    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421"} err="failed to get container status \"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421\": rpc error: code = NotFound desc = could not find container \"579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421\": container with ID starting with 579b8edb4737c4b2979c6033d1a183bdd514aeb50c7b7e0202f7158646f6d421 not found: ID does not exist"
Jul 28 17:15:19.368468 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368421    2579 scope.go:117] "RemoveContainer" containerID="0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"
Jul 28 17:15:19.368610 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368595    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937"} err="failed to get container status \"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937\": rpc error: code = NotFound desc = could not find container \"0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937\": container with ID starting with 0583f31091dbf5504217f5cb77f187c1382b3ca6023b913ae63e9ccb107d1937 not found: ID does not exist"
Jul 28 17:15:19.368644 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368610    2579 scope.go:117] "RemoveContainer" containerID="baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"
Jul 28 17:15:19.368835 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368818    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599"} err="failed to get container status \"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599\": rpc error: code = NotFound desc = could not find container \"baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599\": container with ID starting with baa723a592f00e916f53f8bd921b6fb3496c59390e148672e7e5965b26cfd599 not found: ID does not exist"
Jul 28 17:15:19.368875 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368837    2579 scope.go:117] "RemoveContainer" containerID="6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"
Jul 28 17:15:19.369012 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.368993    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8"} err="failed to get container status \"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8\": rpc error: code = NotFound desc = could not find container \"6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8\": container with ID starting with 6cc354b4f09d9a5da33d84aa0603e74391422b3e9a6b3ea78c438b7c4e8efdb8 not found: ID does not exist"
Jul 28 17:15:19.369057 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.369015    2579 scope.go:117] "RemoveContainer" containerID="e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"
Jul 28 17:15:19.369186 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.369171    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f"} err="failed to get container status \"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f\": rpc error: code = NotFound desc = could not find container \"e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f\": container with ID starting with e7b4f5b5481509052714b3d1c992611e1683be0dc3b0401c63623df4d476ee8f not found: ID does not exist"
Jul 28 17:15:19.369227 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.369203    2579 scope.go:117] "RemoveContainer" containerID="72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"
Jul 28 17:15:19.369411 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.369392    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2"} err="failed to get container status \"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2\": rpc error: code = NotFound desc = could not find container \"72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2\": container with ID starting with 72c370cedba6e8cae59f000e742ab760f3b4b4223e717ca194f588d9f63109f2 not found: ID does not exist"
Jul 28 17:15:19.375375 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375353    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:15:19.375617 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375605    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="prom-label-proxy"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375619    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="prom-label-proxy"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375630    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="config-reloader"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375637    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="config-reloader"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375647    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="init-config-reloader"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375653    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="init-config-reloader"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375660    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy"
Jul 28 17:15:19.375665 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375665    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375678    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-metric"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375684    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-metric"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375690    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-web"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375696    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-web"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375708    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900126f9-3524-4749-958f-681382d31027" containerName="alertmanager"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375713    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="900126f9-3524-4749-958f-681382d31027" containerName="alertmanager"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375752    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375760    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-web"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375765    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="900126f9-3524-4749-958f-681382d31027" containerName="kube-rbac-proxy-metric"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375772    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="900126f9-3524-4749-958f-681382d31027" containerName="config-reloader"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375779    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="900126f9-3524-4749-958f-681382d31027" containerName="prom-label-proxy"
Jul 28 17:15:19.375887 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.375786    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="900126f9-3524-4749-958f-681382d31027" containerName="alertmanager"
Jul 28 17:15:19.379363 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.379346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.382354 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382336    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 17:15:19.382434 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382338    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 17:15:19.382606 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382587    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 17:15:19.382710 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382693    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 17:15:19.382782 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8xh4b\""
Jul 28 17:15:19.382851 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 17:15:19.382901 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.382837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 17:15:19.383399 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.383380    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 17:15:19.383481 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.383416    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 17:15:19.387892 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.387874    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 17:15:19.393768 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.393745    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:15:19.466603 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5742f24-eb96-4040-844c-11747bcede1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466603 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466813 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466813 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5742f24-eb96-4040-844c-11747bcede1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466813 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5742f24-eb96-4040-844c-11747bcede1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466813 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrdv\" (UniqueName: \"kubernetes.io/projected/a5742f24-eb96-4040-844c-11747bcede1d-kube-api-access-4zrdv\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466813 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466982 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-web-config\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466982 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5742f24-eb96-4040-844c-11747bcede1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466982 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466982 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466982 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5742f24-eb96-4040-844c-11747bcede1d-config-out\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.466982 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.466935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.567985 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.567888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.567985 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.567944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-web-config\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.567985 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.567960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5742f24-eb96-4040-844c-11747bcede1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.567985 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.567975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5742f24-eb96-4040-844c-11747bcede1d-config-out\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5742f24-eb96-4040-844c-11747bcede1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5742f24-eb96-4040-844c-11747bcede1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5742f24-eb96-4040-844c-11747bcede1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.568324 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.568226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrdv\" (UniqueName: \"kubernetes.io/projected/a5742f24-eb96-4040-844c-11747bcede1d-kube-api-access-4zrdv\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.569828 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.569441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5742f24-eb96-4040-844c-11747bcede1d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571188 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5742f24-eb96-4040-844c-11747bcede1d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571329 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571391 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-web-config\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571391 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571482 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571482 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571482 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5742f24-eb96-4040-844c-11747bcede1d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571785 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5742f24-eb96-4040-844c-11747bcede1d-config-out\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.571943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.571924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5742f24-eb96-4040-844c-11747bcede1d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.572241 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.572222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.573146 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.573130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5742f24-eb96-4040-844c-11747bcede1d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.577202 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.577184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrdv\" (UniqueName: \"kubernetes.io/projected/a5742f24-eb96-4040-844c-11747bcede1d-kube-api-access-4zrdv\") pod \"alertmanager-main-0\" (UID: \"a5742f24-eb96-4040-844c-11747bcede1d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.688717 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.688679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:15:19.832860 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:19.832763    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:15:19.836825 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:15:19.836799    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5742f24_eb96_4040_844c_11747bcede1d.slice/crio-5967a7e5ae4b319d6e6f5888331f605f7c9446088d76d8931f5b55283767776c WatchSource:0}: Error finding container 5967a7e5ae4b319d6e6f5888331f605f7c9446088d76d8931f5b55283767776c: Status 404 returned error can't find the container with id 5967a7e5ae4b319d6e6f5888331f605f7c9446088d76d8931f5b55283767776c
Jul 28 17:15:20.322178 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:20.322145    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5742f24-eb96-4040-844c-11747bcede1d" containerID="66c3041a6f51a0ef28a1670d12d00f2a7316b8c940d70da5eac13ac2b7b8e146" exitCode=0
Jul 28 17:15:20.322566 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:20.322192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerDied","Data":"66c3041a6f51a0ef28a1670d12d00f2a7316b8c940d70da5eac13ac2b7b8e146"}
Jul 28 17:15:20.322566 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:20.322241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"5967a7e5ae4b319d6e6f5888331f605f7c9446088d76d8931f5b55283767776c"}
Jul 28 17:15:20.931227 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:20.931193    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="900126f9-3524-4749-958f-681382d31027" path="/var/lib/kubelet/pods/900126f9-3524-4749-958f-681382d31027/volumes"
Jul 28 17:15:21.328803 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.328719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"0e37d944639da0505eb95b90c11718aafd80cec0e747b972036e9a9da4ccda1f"}
Jul 28 17:15:21.328803 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.328802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"ef9a39ce0e62797c73757d9186d690c775b1334e3cb912160d3db2fb190f0709"}
Jul 28 17:15:21.329179 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.328842    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"94bfb339e5a08a3c9d9a1bbc7db79847f880b7bcb67e11c878b4e446dcf5b533"}
Jul 28 17:15:21.329179 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.328884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"2942739745ec48241b77940af8d05971561bb9f0f9ae949e5945e7b54cad7bf2"}
Jul 28 17:15:21.329179 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.328921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"eee86e000c33047902c499b18fbd7c37569a5b9eed7ef345c178541c539fcbd1"}
Jul 28 17:15:21.329179 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.328954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5742f24-eb96-4040-844c-11747bcede1d","Type":"ContainerStarted","Data":"4aab89e5e18c0ec87e55a6cd80330247b25cb4aae31cc689f25ffce62483adec"}
Jul 28 17:15:21.361255 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:15:21.361212    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.345147406 podStartE2EDuration="2.361199041s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.051635ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:15:21.359217385 +0000 UTC m=+387.033170330" watchObservedRunningTime="2026-07-28 17:15:21.361199041 +0000 UTC m=+387.035151986"
Jul 28 17:16:31.446786 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.446747    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"]
Jul 28 17:16:31.449253 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.449235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.452782 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.452760    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 17:16:31.452925 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.452804    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nr4hv\""
Jul 28 17:16:31.452925 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.452843    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 17:16:31.464632 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.464612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"]
Jul 28 17:16:31.577157 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.577107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.577157 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.577160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhv72\" (UniqueName: \"kubernetes.io/projected/acb48285-2829-49a0-b884-2e66891942b4-kube-api-access-jhv72\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.577397 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.577261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.678331 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.678293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.678491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.678348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.678491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.678367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhv72\" (UniqueName: \"kubernetes.io/projected/acb48285-2829-49a0-b884-2e66891942b4-kube-api-access-jhv72\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.678672 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.678651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.678708 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.678678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.687488 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.687457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhv72\" (UniqueName: \"kubernetes.io/projected/acb48285-2829-49a0-b884-2e66891942b4-kube-api-access-jhv72\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.758540 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.758462    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:31.885050 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:31.885028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"]
Jul 28 17:16:31.887772 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:16:31.887744    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb48285_2829_49a0_b884_2e66891942b4.slice/crio-8de5a94328f0d12e2470e3de0df3f6b4eac98dfebef57f6dea1379dadeee0662 WatchSource:0}: Error finding container 8de5a94328f0d12e2470e3de0df3f6b4eac98dfebef57f6dea1379dadeee0662: Status 404 returned error can't find the container with id 8de5a94328f0d12e2470e3de0df3f6b4eac98dfebef57f6dea1379dadeee0662
Jul 28 17:16:32.595767 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:32.595725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerStarted","Data":"8de5a94328f0d12e2470e3de0df3f6b4eac98dfebef57f6dea1379dadeee0662"}
Jul 28 17:16:38.623653 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:38.623619    2579 generic.go:356] "Generic (PLEG): container finished" podID="acb48285-2829-49a0-b884-2e66891942b4" containerID="a2941277c7b3a30fb4ca4cfc0c08c0ad7d4deb8173bbd09928906fd9e688a182" exitCode=0
Jul 28 17:16:38.624029 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:38.623692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerDied","Data":"a2941277c7b3a30fb4ca4cfc0c08c0ad7d4deb8173bbd09928906fd9e688a182"}
Jul 28 17:16:40.633668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:40.633639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerStarted","Data":"79a99857620611b8ddaa7b954ec0d39124ad314a3db706cd1dfc688a3eb4d4bd"}
Jul 28 17:16:41.639228 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:41.639186    2579 generic.go:356] "Generic (PLEG): container finished" podID="acb48285-2829-49a0-b884-2e66891942b4" containerID="79a99857620611b8ddaa7b954ec0d39124ad314a3db706cd1dfc688a3eb4d4bd" exitCode=0
Jul 28 17:16:41.639228 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:41.639231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerDied","Data":"79a99857620611b8ddaa7b954ec0d39124ad314a3db706cd1dfc688a3eb4d4bd"}
Jul 28 17:16:48.672529 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:48.672494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerStarted","Data":"afeb3fb5c53905517b97ba3be7de9ddba66b17277b87201ec8c9e154c64d52b6"}
Jul 28 17:16:48.702702 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:48.702655    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" podStartSLOduration=2.862065904 podStartE2EDuration="17.702641074s" totalImagesPullingTime="14.84057517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:16:48.701518742 +0000 UTC m=+474.375471687" watchObservedRunningTime="2026-07-28 17:16:48.702641074 +0000 UTC m=+474.376594018"
Jul 28 17:16:49.678350 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:49.678319    2579 generic.go:356] "Generic (PLEG): container finished" podID="acb48285-2829-49a0-b884-2e66891942b4" containerID="afeb3fb5c53905517b97ba3be7de9ddba66b17277b87201ec8c9e154c64d52b6" exitCode=0
Jul 28 17:16:49.678703 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:49.678390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerDied","Data":"afeb3fb5c53905517b97ba3be7de9ddba66b17277b87201ec8c9e154c64d52b6"}
Jul 28 17:16:50.805834 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.805811    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:50.939750 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.939681    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhv72\" (UniqueName: \"kubernetes.io/projected/acb48285-2829-49a0-b884-2e66891942b4-kube-api-access-jhv72\") pod \"acb48285-2829-49a0-b884-2e66891942b4\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") "
Jul 28 17:16:50.939750 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.939720    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-bundle\") pod \"acb48285-2829-49a0-b884-2e66891942b4\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") "
Jul 28 17:16:50.939916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.939764    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-util\") pod \"acb48285-2829-49a0-b884-2e66891942b4\" (UID: \"acb48285-2829-49a0-b884-2e66891942b4\") "
Jul 28 17:16:50.940574 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.940542    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-bundle" (OuterVolumeSpecName: "bundle") pod "acb48285-2829-49a0-b884-2e66891942b4" (UID: "acb48285-2829-49a0-b884-2e66891942b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:16:50.941884 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.941857    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb48285-2829-49a0-b884-2e66891942b4-kube-api-access-jhv72" (OuterVolumeSpecName: "kube-api-access-jhv72") pod "acb48285-2829-49a0-b884-2e66891942b4" (UID: "acb48285-2829-49a0-b884-2e66891942b4"). InnerVolumeSpecName "kube-api-access-jhv72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:16:50.944874 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:50.944849    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-util" (OuterVolumeSpecName: "util") pod "acb48285-2829-49a0-b884-2e66891942b4" (UID: "acb48285-2829-49a0-b884-2e66891942b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:16:51.040311 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:51.040286    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhv72\" (UniqueName: \"kubernetes.io/projected/acb48285-2829-49a0-b884-2e66891942b4-kube-api-access-jhv72\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:16:51.040311 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:51.040310    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-bundle\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:16:51.040452 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:51.040320    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb48285-2829-49a0-b884-2e66891942b4-util\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:16:51.687733 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:51.687698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v" event={"ID":"acb48285-2829-49a0-b884-2e66891942b4","Type":"ContainerDied","Data":"8de5a94328f0d12e2470e3de0df3f6b4eac98dfebef57f6dea1379dadeee0662"}
Jul 28 17:16:51.687891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:51.687741    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8de5a94328f0d12e2470e3de0df3f6b4eac98dfebef57f6dea1379dadeee0662"
Jul 28 17:16:51.687891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:51.687751    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znz9v"
Jul 28 17:16:53.796448 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796417    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"]
Jul 28 17:16:53.796810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796723    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="extract"
Jul 28 17:16:53.796810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796734    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="extract"
Jul 28 17:16:53.796810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796745    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="util"
Jul 28 17:16:53.796810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="util"
Jul 28 17:16:53.796810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796761    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="pull"
Jul 28 17:16:53.796810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796768    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="pull"
Jul 28 17:16:53.796991 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.796821    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb48285-2829-49a0-b884-2e66891942b4" containerName="extract"
Jul 28 17:16:53.798974 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.798958    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:53.805446 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.805421    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 28 17:16:53.805570 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.805494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 28 17:16:53.805635 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.805576    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 28 17:16:53.807153 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.807140    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-qrnxs\""
Jul 28 17:16:53.818631 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.818609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"]
Jul 28 17:16:53.958870 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.958847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7td9\" (UniqueName: \"kubernetes.io/projected/efdb18c9-da2b-4851-a436-b0418c45b804-kube-api-access-h7td9\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-chhbz\" (UID: \"efdb18c9-da2b-4851-a436-b0418c45b804\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:53.958992 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:53.958903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/efdb18c9-da2b-4851-a436-b0418c45b804-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-chhbz\" (UID: \"efdb18c9-da2b-4851-a436-b0418c45b804\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:54.059803 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.059747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/efdb18c9-da2b-4851-a436-b0418c45b804-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-chhbz\" (UID: \"efdb18c9-da2b-4851-a436-b0418c45b804\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:54.059803 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.059794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7td9\" (UniqueName: \"kubernetes.io/projected/efdb18c9-da2b-4851-a436-b0418c45b804-kube-api-access-h7td9\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-chhbz\" (UID: \"efdb18c9-da2b-4851-a436-b0418c45b804\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:54.061978 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.061952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/efdb18c9-da2b-4851-a436-b0418c45b804-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-chhbz\" (UID: \"efdb18c9-da2b-4851-a436-b0418c45b804\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:54.074912 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.074891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7td9\" (UniqueName: \"kubernetes.io/projected/efdb18c9-da2b-4851-a436-b0418c45b804-kube-api-access-h7td9\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-chhbz\" (UID: \"efdb18c9-da2b-4851-a436-b0418c45b804\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:54.108365 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.108346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:16:54.237666 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.237637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"]
Jul 28 17:16:54.243305 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:16:54.243263    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdb18c9_da2b_4851_a436_b0418c45b804.slice/crio-a4e1e6297effc365d3da0282240b736633ca45369e140bef0293ec95e1e23f76 WatchSource:0}: Error finding container a4e1e6297effc365d3da0282240b736633ca45369e140bef0293ec95e1e23f76: Status 404 returned error can't find the container with id a4e1e6297effc365d3da0282240b736633ca45369e140bef0293ec95e1e23f76
Jul 28 17:16:54.701580 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:16:54.701540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz" event={"ID":"efdb18c9-da2b-4851-a436-b0418c45b804","Type":"ContainerStarted","Data":"a4e1e6297effc365d3da0282240b736633ca45369e140bef0293ec95e1e23f76"}
Jul 28 17:17:04.746127 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:04.746092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz" event={"ID":"efdb18c9-da2b-4851-a436-b0418c45b804","Type":"ContainerStarted","Data":"7b6f1397b5214ba2dd49b164a2182bfa90893eae6229dddb60e3c7cc2562b660"}
Jul 28 17:17:04.746548 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:04.746212    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:17:04.770979 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:04.770940    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz" podStartSLOduration=1.7817748629999999 podStartE2EDuration="11.770927717s" totalImagesPullingTime="9.989152854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:04.768600105 +0000 UTC m=+490.442553051" watchObservedRunningTime="2026-07-28 17:17:04.770927717 +0000 UTC m=+490.444880660"
Jul 28 17:17:05.119360 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.119324    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"]
Jul 28 17:17:05.123142 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.123123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.125972 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.125947    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 28 17:17:05.126250 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.126234    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-vtwsb\""
Jul 28 17:17:05.126360 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.126242    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 28 17:17:05.132520 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.132498    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"]
Jul 28 17:17:05.148667 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.148634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-certificates\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.148758 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.148703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/497436d7-f727-446e-b039-e324dd022bbe-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.148758 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.148726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvkb\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-kube-api-access-kdvkb\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.249178 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.249150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-certificates\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.249350 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.249219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/497436d7-f727-446e-b039-e324dd022bbe-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.249350 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.249245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvkb\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-kube-api-access-kdvkb\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.249350 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:17:05.249314    2579 secret.go:281] references non-existent secret key: tls.crt
Jul 28 17:17:05.249350 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:17:05.249331    2579 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 28 17:17:05.249350 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:17:05.249346    2579 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
Jul 28 17:17:05.249606 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:17:05.249363    2579 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Jul 28 17:17:05.249606 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:17:05.249431    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-certificates podName:497436d7-f727-446e-b039-e324dd022bbe nodeName:}" failed. No retries permitted until 2026-07-28 17:17:05.749414012 +0000 UTC m=+491.423366941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-certificates") pod "keda-metrics-apiserver-55557df8c-qv6gr" (UID: "497436d7-f727-446e-b039-e324dd022bbe") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Jul 28 17:17:05.249732 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.249700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/497436d7-f727-446e-b039-e324dd022bbe-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.266460 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.266435    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvkb\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-kube-api-access-kdvkb\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.754352 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.754321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-certificates\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:05.756903 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:05.756871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/497436d7-f727-446e-b039-e324dd022bbe-certificates\") pod \"keda-metrics-apiserver-55557df8c-qv6gr\" (UID: \"497436d7-f727-446e-b039-e324dd022bbe\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:06.034373 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:06.034293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:06.162302 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:06.162281    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"]
Jul 28 17:17:06.164660 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:17:06.164627    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497436d7_f727_446e_b039_e324dd022bbe.slice/crio-67ff73ef97ea946f0b444338ef855135f433bb4a1703bc11f34e0e182692025c WatchSource:0}: Error finding container 67ff73ef97ea946f0b444338ef855135f433bb4a1703bc11f34e0e182692025c: Status 404 returned error can't find the container with id 67ff73ef97ea946f0b444338ef855135f433bb4a1703bc11f34e0e182692025c
Jul 28 17:17:06.755835 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:06.755802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr" event={"ID":"497436d7-f727-446e-b039-e324dd022bbe","Type":"ContainerStarted","Data":"67ff73ef97ea946f0b444338ef855135f433bb4a1703bc11f34e0e182692025c"}
Jul 28 17:17:09.773116 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:09.773080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr" event={"ID":"497436d7-f727-446e-b039-e324dd022bbe","Type":"ContainerStarted","Data":"4307e68b5b66c5621232a590267936368909996584642c94ff409a48da43e98d"}
Jul 28 17:17:09.773523 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:09.773220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:09.793553 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:09.793512    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr" podStartSLOduration=2.118317112 podStartE2EDuration="4.793500336s" totalImagesPullingTime="2.675183224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:09.79113869 +0000 UTC m=+495.465091634" watchObservedRunningTime="2026-07-28 17:17:09.793500336 +0000 UTC m=+495.467453280"
Jul 28 17:17:20.782656 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:20.782630    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qv6gr"
Jul 28 17:17:25.753205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:17:25.753176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-chhbz"
Jul 28 17:18:22.123263 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.123222    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-bspjc"]
Jul 28 17:18:22.125772 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.125752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.129043 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.129017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 28 17:18:22.129148 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.129069    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 17:18:22.130699 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.130677    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-hdg8c\""
Jul 28 17:18:22.130896 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.130876    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 17:18:22.136307 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.136287    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-bspjc"]
Jul 28 17:18:22.280534 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.280509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e-cert\") pod \"llmisvc-controller-manager-654c557856-bspjc\" (UID: \"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e\") " pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.280704 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.280551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxtrd\" (UniqueName: \"kubernetes.io/projected/a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e-kube-api-access-xxtrd\") pod \"llmisvc-controller-manager-654c557856-bspjc\" (UID: \"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e\") " pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.381031 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.380964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e-cert\") pod \"llmisvc-controller-manager-654c557856-bspjc\" (UID: \"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e\") " pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.381031 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.381004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxtrd\" (UniqueName: \"kubernetes.io/projected/a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e-kube-api-access-xxtrd\") pod \"llmisvc-controller-manager-654c557856-bspjc\" (UID: \"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e\") " pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.383313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.383292    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e-cert\") pod \"llmisvc-controller-manager-654c557856-bspjc\" (UID: \"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e\") " pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.389125 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.389098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxtrd\" (UniqueName: \"kubernetes.io/projected/a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e-kube-api-access-xxtrd\") pod \"llmisvc-controller-manager-654c557856-bspjc\" (UID: \"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e\") " pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.438215 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.438191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:22.563768 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:22.563734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-bspjc"]
Jul 28 17:18:23.080762 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:23.080729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-bspjc" event={"ID":"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e","Type":"ContainerStarted","Data":"286fc542e7c275b2e731e170d60620f1b602d281435c7d93094e7ceebe0daa9c"}
Jul 28 17:18:26.095118 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:26.095074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-bspjc" event={"ID":"a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e","Type":"ContainerStarted","Data":"885cd22dff0755b425fe128fd827dec305c93a40e934dbdc2a0478e235c4877d"}
Jul 28 17:18:26.095583 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:26.095145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:18:26.113522 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:26.113477    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-bspjc" podStartSLOduration=1.64994526 podStartE2EDuration="4.113465181s" totalImagesPullingTime="2.463519921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:26.112557398 +0000 UTC m=+571.786510342" watchObservedRunningTime="2026-07-28 17:18:26.113465181 +0000 UTC m=+571.787418145"
Jul 28 17:18:54.780205 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:54.780180    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:18:54.781095 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:54.781074    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:18:57.101628 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:18:57.101599    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-bspjc"
Jul 28 17:19:38.812363 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.812317    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-xp77r"]
Jul 28 17:19:38.815208 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.815189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:38.818891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.818857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-t78dg\""
Jul 28 17:19:38.819292 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.819256    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 28 17:19:38.826586 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.826566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-xp77r"]
Jul 28 17:19:38.922842 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.922805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xpc\" (UniqueName: \"kubernetes.io/projected/811a6eef-802f-4165-8616-bc5475492b77-kube-api-access-n9xpc\") pod \"model-serving-api-7b954ffc95-xp77r\" (UID: \"811a6eef-802f-4165-8616-bc5475492b77\") " pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:38.923021 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:38.922859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/811a6eef-802f-4165-8616-bc5475492b77-tls-certs\") pod \"model-serving-api-7b954ffc95-xp77r\" (UID: \"811a6eef-802f-4165-8616-bc5475492b77\") " pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:39.024377 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.024316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xpc\" (UniqueName: \"kubernetes.io/projected/811a6eef-802f-4165-8616-bc5475492b77-kube-api-access-n9xpc\") pod \"model-serving-api-7b954ffc95-xp77r\" (UID: \"811a6eef-802f-4165-8616-bc5475492b77\") " pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:39.024550 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.024394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/811a6eef-802f-4165-8616-bc5475492b77-tls-certs\") pod \"model-serving-api-7b954ffc95-xp77r\" (UID: \"811a6eef-802f-4165-8616-bc5475492b77\") " pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:39.026781 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.026761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/811a6eef-802f-4165-8616-bc5475492b77-tls-certs\") pod \"model-serving-api-7b954ffc95-xp77r\" (UID: \"811a6eef-802f-4165-8616-bc5475492b77\") " pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:39.036338 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.036315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xpc\" (UniqueName: \"kubernetes.io/projected/811a6eef-802f-4165-8616-bc5475492b77-kube-api-access-n9xpc\") pod \"model-serving-api-7b954ffc95-xp77r\" (UID: \"811a6eef-802f-4165-8616-bc5475492b77\") " pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:39.126057 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.126029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:39.261624 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.261594    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-xp77r"]
Jul 28 17:19:39.264994 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:19:39.264964    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811a6eef_802f_4165_8616_bc5475492b77.slice/crio-7f034b533532c01cfc8f4a6bdf07d3f7c5d726755c9d692508093d32300299e0 WatchSource:0}: Error finding container 7f034b533532c01cfc8f4a6bdf07d3f7c5d726755c9d692508093d32300299e0: Status 404 returned error can't find the container with id 7f034b533532c01cfc8f4a6bdf07d3f7c5d726755c9d692508093d32300299e0
Jul 28 17:19:39.267401 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.267383    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:19:39.398186 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:39.398101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-xp77r" event={"ID":"811a6eef-802f-4165-8616-bc5475492b77","Type":"ContainerStarted","Data":"7f034b533532c01cfc8f4a6bdf07d3f7c5d726755c9d692508093d32300299e0"}
Jul 28 17:19:42.414195 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:42.414162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-xp77r" event={"ID":"811a6eef-802f-4165-8616-bc5475492b77","Type":"ContainerStarted","Data":"f35ba714e2826faeec70e5adb8379c664af974a7e0d34ec9af1804bd87a225ac"}
Jul 28 17:19:42.414571 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:42.414311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:19:42.434437 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:42.434376    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-xp77r" podStartSLOduration=2.210693859 podStartE2EDuration="4.434362129s" totalImagesPullingTime="2.22366827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:42.433087726 +0000 UTC m=+648.107040671" watchObservedRunningTime="2026-07-28 17:19:42.434362129 +0000 UTC m=+648.108315074"
Jul 28 17:19:53.422414 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:19:53.422382    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-xp77r"
Jul 28 17:21:32.177714 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.177677    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"]
Jul 28 17:21:32.181084 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.181064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.184413 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.184384    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:21:32.184413 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.184409    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-895bt\""
Jul 28 17:21:32.184602 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.184423    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b94d0-kube-rbac-proxy-sar-config\""
Jul 28 17:21:32.184602 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.184409    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 17:21:32.185790 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.185768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b94d0-predictor-serving-cert\""
Jul 28 17:21:32.193408 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.193381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"]
Jul 28 17:21:32.284759 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.284703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.284942 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.284838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d25ef18-6f62-4906-91bd-63a4828c35d8-proxy-tls\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.284942 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.284871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4r9\" (UniqueName: \"kubernetes.io/projected/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-api-access-kp4r9\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.386039 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.385998    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d25ef18-6f62-4906-91bd-63a4828c35d8-proxy-tls\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.386216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.386038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4r9\" (UniqueName: \"kubernetes.io/projected/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-api-access-kp4r9\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.386216 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.386098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.386852 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.386799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.388667 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.388643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d25ef18-6f62-4906-91bd-63a4828c35d8-proxy-tls\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.396417 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.396394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4r9\" (UniqueName: \"kubernetes.io/projected/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-api-access-kp4r9\") pod \"error-404-isvc-b94d0-predictor-57d9b4447b-cgg27\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") " pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.492437 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.492334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:32.644093 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.644067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"]
Jul 28 17:21:32.646883 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:21:32.646851    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d25ef18_6f62_4906_91bd_63a4828c35d8.slice/crio-b79735205fa1068e44a381c1774f4efc7058861882d86a90ce3e9c4cacc5acc1 WatchSource:0}: Error finding container b79735205fa1068e44a381c1774f4efc7058861882d86a90ce3e9c4cacc5acc1: Status 404 returned error can't find the container with id b79735205fa1068e44a381c1774f4efc7058861882d86a90ce3e9c4cacc5acc1
Jul 28 17:21:32.896334 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:32.896294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" event={"ID":"8d25ef18-6f62-4906-91bd-63a4828c35d8","Type":"ContainerStarted","Data":"b79735205fa1068e44a381c1774f4efc7058861882d86a90ce3e9c4cacc5acc1"}
Jul 28 17:21:44.967349 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:44.967252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" event={"ID":"8d25ef18-6f62-4906-91bd-63a4828c35d8","Type":"ContainerStarted","Data":"beaf1184eb4b6ec1d8834fe54b2da469c99dce70bb473de5356d62753fa41d52"}
Jul 28 17:21:46.978907 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:46.978866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" event={"ID":"8d25ef18-6f62-4906-91bd-63a4828c35d8","Type":"ContainerStarted","Data":"5643b6832c89227079682b4a521733bab3163738d9ff49b7cb8bc83d13bede63"}
Jul 28 17:21:46.979443 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:46.978935    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:46.979443 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:46.979084    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:46.980547 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:46.980519    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:21:47.004830 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:47.004775    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podStartSLOduration=1.398369682 podStartE2EDuration="15.004758979s" totalImagesPullingTime="13.606389297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:21:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:21:47.002872219 +0000 UTC m=+772.676825165" watchObservedRunningTime="2026-07-28 17:21:47.004758979 +0000 UTC m=+772.678711924"
Jul 28 17:21:47.984199 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:47.984161    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:21:52.988787 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:52.988753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:21:52.989380 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:21:52.989347    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:22:02.989629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:22:02.989587    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:22:12.990258 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:22:12.990212    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:22:22.990066 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:22:22.989980    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:22:32.990383 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:22:32.990352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:23:02.072455 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.072419    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"]
Jul 28 17:23:02.072959 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.072658    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" containerID="cri-o://beaf1184eb4b6ec1d8834fe54b2da469c99dce70bb473de5356d62753fa41d52" gracePeriod=30
Jul 28 17:23:02.072959 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.072711    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kube-rbac-proxy" containerID="cri-o://5643b6832c89227079682b4a521733bab3163738d9ff49b7cb8bc83d13bede63" gracePeriod=30
Jul 28 17:23:02.187097 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.187063    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"]
Jul 28 17:23:02.189589 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.189570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.192490 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.192462    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-391b7-predictor-serving-cert\""
Jul 28 17:23:02.192635 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.192572    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-391b7-kube-rbac-proxy-sar-config\""
Jul 28 17:23:02.200478 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.200452    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"]
Jul 28 17:23:02.330852 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.330769    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerID="5643b6832c89227079682b4a521733bab3163738d9ff49b7cb8bc83d13bede63" exitCode=2
Jul 28 17:23:02.330852 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.330838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" event={"ID":"8d25ef18-6f62-4906-91bd-63a4828c35d8","Type":"ContainerDied","Data":"5643b6832c89227079682b4a521733bab3163738d9ff49b7cb8bc83d13bede63"}
Jul 28 17:23:02.349874 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.349831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/07e2a171-286b-44fb-97ce-d1174e076de7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.349874 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.349873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgps4\" (UniqueName: \"kubernetes.io/projected/07e2a171-286b-44fb-97ce-d1174e076de7-kube-api-access-cgps4\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.350089 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.349915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/07e2a171-286b-44fb-97ce-d1174e076de7-proxy-tls\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.450451 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.450414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/07e2a171-286b-44fb-97ce-d1174e076de7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.450451 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.450451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgps4\" (UniqueName: \"kubernetes.io/projected/07e2a171-286b-44fb-97ce-d1174e076de7-kube-api-access-cgps4\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.450672 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.450570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/07e2a171-286b-44fb-97ce-d1174e076de7-proxy-tls\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.451073 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.451056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/07e2a171-286b-44fb-97ce-d1174e076de7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.452996 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.452973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/07e2a171-286b-44fb-97ce-d1174e076de7-proxy-tls\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.461801 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.461774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgps4\" (UniqueName: \"kubernetes.io/projected/07e2a171-286b-44fb-97ce-d1174e076de7-kube-api-access-cgps4\") pod \"error-404-isvc-391b7-predictor-694d665486-h66x4\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") " pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.502144 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.502097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:02.632647 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.632624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"]
Jul 28 17:23:02.634568 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:23:02.634536    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e2a171_286b_44fb_97ce_d1174e076de7.slice/crio-102b258bceb8ce3f1e391dead75bd18cd160f3e70ee805991d28df972f2615f1 WatchSource:0}: Error finding container 102b258bceb8ce3f1e391dead75bd18cd160f3e70ee805991d28df972f2615f1: Status 404 returned error can't find the container with id 102b258bceb8ce3f1e391dead75bd18cd160f3e70ee805991d28df972f2615f1
Jul 28 17:23:02.985281 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.985235    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused"
Jul 28 17:23:02.989578 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:02.989555    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 17:23:03.337289 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:03.337179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" event={"ID":"07e2a171-286b-44fb-97ce-d1174e076de7","Type":"ContainerStarted","Data":"c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac"}
Jul 28 17:23:03.337289 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:03.337241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" event={"ID":"07e2a171-286b-44fb-97ce-d1174e076de7","Type":"ContainerStarted","Data":"9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605"}
Jul 28 17:23:03.337719 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:03.337398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:03.337719 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:03.337456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" event={"ID":"07e2a171-286b-44fb-97ce-d1174e076de7","Type":"ContainerStarted","Data":"102b258bceb8ce3f1e391dead75bd18cd160f3e70ee805991d28df972f2615f1"}
Jul 28 17:23:03.359044 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:03.358989    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podStartSLOduration=1.3589726500000001 podStartE2EDuration="1.35897265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:03.35820321 +0000 UTC m=+849.032156155" watchObservedRunningTime="2026-07-28 17:23:03.35897265 +0000 UTC m=+849.032925595"
Jul 28 17:23:04.344386 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:04.344352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:04.345768 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:04.345731    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:23:05.350926 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.350882    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerID="beaf1184eb4b6ec1d8834fe54b2da469c99dce70bb473de5356d62753fa41d52" exitCode=0
Jul 28 17:23:05.351391 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.351339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" event={"ID":"8d25ef18-6f62-4906-91bd-63a4828c35d8","Type":"ContainerDied","Data":"beaf1184eb4b6ec1d8834fe54b2da469c99dce70bb473de5356d62753fa41d52"}
Jul 28 17:23:05.351811 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.351773    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:23:05.419007 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.418983    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:23:05.577095 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.577004    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d25ef18-6f62-4906-91bd-63a4828c35d8-proxy-tls\") pod \"8d25ef18-6f62-4906-91bd-63a4828c35d8\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") "
Jul 28 17:23:05.577095 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.577049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-rbac-proxy-sar-config\") pod \"8d25ef18-6f62-4906-91bd-63a4828c35d8\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") "
Jul 28 17:23:05.577353 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.577104    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp4r9\" (UniqueName: \"kubernetes.io/projected/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-api-access-kp4r9\") pod \"8d25ef18-6f62-4906-91bd-63a4828c35d8\" (UID: \"8d25ef18-6f62-4906-91bd-63a4828c35d8\") "
Jul 28 17:23:05.577501 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.577479    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8d25ef18-6f62-4906-91bd-63a4828c35d8" (UID: "8d25ef18-6f62-4906-91bd-63a4828c35d8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:23:05.579335 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.579301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d25ef18-6f62-4906-91bd-63a4828c35d8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8d25ef18-6f62-4906-91bd-63a4828c35d8" (UID: "8d25ef18-6f62-4906-91bd-63a4828c35d8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:23:05.579424 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.579354    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-api-access-kp4r9" (OuterVolumeSpecName: "kube-api-access-kp4r9") pod "8d25ef18-6f62-4906-91bd-63a4828c35d8" (UID: "8d25ef18-6f62-4906-91bd-63a4828c35d8"). InnerVolumeSpecName "kube-api-access-kp4r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:23:05.678789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.678750    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp4r9\" (UniqueName: \"kubernetes.io/projected/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-api-access-kp4r9\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:23:05.678789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.678782    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d25ef18-6f62-4906-91bd-63a4828c35d8-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:23:05.678789 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:05.678796    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d25ef18-6f62-4906-91bd-63a4828c35d8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:23:06.358077 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.358035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27" event={"ID":"8d25ef18-6f62-4906-91bd-63a4828c35d8","Type":"ContainerDied","Data":"b79735205fa1068e44a381c1774f4efc7058861882d86a90ce3e9c4cacc5acc1"}
Jul 28 17:23:06.358077 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.358061    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"
Jul 28 17:23:06.358640 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.358118    2579 scope.go:117] "RemoveContainer" containerID="5643b6832c89227079682b4a521733bab3163738d9ff49b7cb8bc83d13bede63"
Jul 28 17:23:06.366813 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.366795    2579 scope.go:117] "RemoveContainer" containerID="beaf1184eb4b6ec1d8834fe54b2da469c99dce70bb473de5356d62753fa41d52"
Jul 28 17:23:06.381596 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.381566    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"]
Jul 28 17:23:06.385739 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.385716    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b94d0-predictor-57d9b4447b-cgg27"]
Jul 28 17:23:06.932128 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:06.932094    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" path="/var/lib/kubelet/pods/8d25ef18-6f62-4906-91bd-63a4828c35d8/volumes"
Jul 28 17:23:10.356200 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:10.356169    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:10.356640 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:10.356617    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:23:20.357608 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:20.357568    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:23:30.357086 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:30.357045    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:23:40.357088 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:40.357045    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:23:50.357536 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:50.357462    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:23:54.808799 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:54.808766    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:23:54.810496 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:23:54.810476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:24:02.101283 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101233    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"]
Jul 28 17:24:02.102824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101732    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kube-rbac-proxy"
Jul 28 17:24:02.102824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101749    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kube-rbac-proxy"
Jul 28 17:24:02.102824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101762    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container"
Jul 28 17:24:02.102824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101770    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container"
Jul 28 17:24:02.102824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101858    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kserve-container"
Jul 28 17:24:02.102824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.101872    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d25ef18-6f62-4906-91bd-63a4828c35d8" containerName="kube-rbac-proxy"
Jul 28 17:24:02.110938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.110915    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.115523 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.115474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-211cd-predictor-serving-cert\""
Jul 28 17:24:02.115900 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.115879    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-211cd-kube-rbac-proxy-sar-config\""
Jul 28 17:24:02.116541 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.116515    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"]
Jul 28 17:24:02.234371 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.234341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn66q\" (UniqueName: \"kubernetes.io/projected/57c14be8-6f23-4efd-a099-ec50390dc451-kube-api-access-tn66q\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.234534 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.234411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57c14be8-6f23-4efd-a099-ec50390dc451-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.234534 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.234446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57c14be8-6f23-4efd-a099-ec50390dc451-proxy-tls\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.335687 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.335655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn66q\" (UniqueName: \"kubernetes.io/projected/57c14be8-6f23-4efd-a099-ec50390dc451-kube-api-access-tn66q\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.335840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.335703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57c14be8-6f23-4efd-a099-ec50390dc451-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.335840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.335724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57c14be8-6f23-4efd-a099-ec50390dc451-proxy-tls\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.336459 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.336429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57c14be8-6f23-4efd-a099-ec50390dc451-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.338126 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.338102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57c14be8-6f23-4efd-a099-ec50390dc451-proxy-tls\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.348363 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.348342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn66q\" (UniqueName: \"kubernetes.io/projected/57c14be8-6f23-4efd-a099-ec50390dc451-kube-api-access-tn66q\") pod \"error-404-isvc-211cd-predictor-7596487544-mvkc7\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") " pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.427132 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.427068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:02.563828 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.563803    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"]
Jul 28 17:24:02.566134 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:24:02.566104    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c14be8_6f23_4efd_a099_ec50390dc451.slice/crio-23d98b18efd167c6fa3e9e5d84609194df30aced947c49d1d35107977167df04 WatchSource:0}: Error finding container 23d98b18efd167c6fa3e9e5d84609194df30aced947c49d1d35107977167df04: Status 404 returned error can't find the container with id 23d98b18efd167c6fa3e9e5d84609194df30aced947c49d1d35107977167df04
Jul 28 17:24:02.623821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:02.623792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" event={"ID":"57c14be8-6f23-4efd-a099-ec50390dc451","Type":"ContainerStarted","Data":"23d98b18efd167c6fa3e9e5d84609194df30aced947c49d1d35107977167df04"}
Jul 28 17:24:03.629442 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:03.629396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" event={"ID":"57c14be8-6f23-4efd-a099-ec50390dc451","Type":"ContainerStarted","Data":"aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21"}
Jul 28 17:24:03.629856 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:03.629501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:03.629856 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:03.629545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:03.629856 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:03.629575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" event={"ID":"57c14be8-6f23-4efd-a099-ec50390dc451","Type":"ContainerStarted","Data":"6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958"}
Jul 28 17:24:03.630815 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:03.630789    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:24:03.651423 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:03.651364    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podStartSLOduration=1.651350434 podStartE2EDuration="1.651350434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:03.649530101 +0000 UTC m=+909.323483051" watchObservedRunningTime="2026-07-28 17:24:03.651350434 +0000 UTC m=+909.325303379"
Jul 28 17:24:04.634406 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:04.634363    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:24:09.638638 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:09.638609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:24:09.639122 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:09.639093    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:24:19.639808 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:19.639765    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:24:29.639938 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:29.639891    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:24:39.639093 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:39.639051    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:24:49.639420 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:24:49.639387    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:28:54.837480 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:28:54.837406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:28:54.839594 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:28:54.839571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:32:17.118944 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.118911    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"]
Jul 28 17:32:17.119624 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.119242    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kube-rbac-proxy" containerID="cri-o://c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac" gracePeriod=30
Jul 28 17:32:17.119624 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.119218    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" containerID="cri-o://9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605" gracePeriod=30
Jul 28 17:32:17.160457 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.160426    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"]
Jul 28 17:32:17.162898 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.162883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.166054 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.166025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-4a23a-kube-rbac-proxy-sar-config\""
Jul 28 17:32:17.166178 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.166160    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-4a23a-predictor-serving-cert\""
Jul 28 17:32:17.175538 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.175516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"]
Jul 28 17:32:17.238497 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.238472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6be7aedd-9954-40f7-a018-8d36a99b4f71-proxy-tls\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.238623 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.238529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghnf\" (UniqueName: \"kubernetes.io/projected/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-api-access-lghnf\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.238623 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.238567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.339430 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.339382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghnf\" (UniqueName: \"kubernetes.io/projected/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-api-access-lghnf\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.339430 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.339435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.339682 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.339521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6be7aedd-9954-40f7-a018-8d36a99b4f71-proxy-tls\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.340168 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.340147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.341886 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.341865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6be7aedd-9954-40f7-a018-8d36a99b4f71-proxy-tls\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.348511 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.348485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghnf\" (UniqueName: \"kubernetes.io/projected/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-api-access-lghnf\") pod \"error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") " pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.472606 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.472521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.608482 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.608450    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"]
Jul 28 17:32:17.611575 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:32:17.611546    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be7aedd_9954_40f7_a018_8d36a99b4f71.slice/crio-6cf203e718a6152fd7c5fc7477fd217f78aef871f9479d6ce6185940b5937f25 WatchSource:0}: Error finding container 6cf203e718a6152fd7c5fc7477fd217f78aef871f9479d6ce6185940b5937f25: Status 404 returned error can't find the container with id 6cf203e718a6152fd7c5fc7477fd217f78aef871f9479d6ce6185940b5937f25
Jul 28 17:32:17.858572 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.858539    2579 generic.go:356] "Generic (PLEG): container finished" podID="07e2a171-286b-44fb-97ce-d1174e076de7" containerID="c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac" exitCode=2
Jul 28 17:32:17.858733 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.858610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" event={"ID":"07e2a171-286b-44fb-97ce-d1174e076de7","Type":"ContainerDied","Data":"c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac"}
Jul 28 17:32:17.860222 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.860196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" event={"ID":"6be7aedd-9954-40f7-a018-8d36a99b4f71","Type":"ContainerStarted","Data":"464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1"}
Jul 28 17:32:17.860392 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.860243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" event={"ID":"6be7aedd-9954-40f7-a018-8d36a99b4f71","Type":"ContainerStarted","Data":"366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1"}
Jul 28 17:32:17.860392 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.860290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.860392 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.860322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:17.860392 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.860339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" event={"ID":"6be7aedd-9954-40f7-a018-8d36a99b4f71","Type":"ContainerStarted","Data":"6cf203e718a6152fd7c5fc7477fd217f78aef871f9479d6ce6185940b5937f25"}
Jul 28 17:32:17.861757 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.861734    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:32:17.884994 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:17.884951    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podStartSLOduration=0.884939461 podStartE2EDuration="884.939461ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:32:17.882166367 +0000 UTC m=+1403.556119337" watchObservedRunningTime="2026-07-28 17:32:17.884939461 +0000 UTC m=+1403.558892406"
Jul 28 17:32:18.864686 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:18.864637    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:32:20.352720 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.352681    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused"
Jul 28 17:32:20.357071 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.357040    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 17:32:20.463823 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.463799    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:32:20.564193 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.564108    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgps4\" (UniqueName: \"kubernetes.io/projected/07e2a171-286b-44fb-97ce-d1174e076de7-kube-api-access-cgps4\") pod \"07e2a171-286b-44fb-97ce-d1174e076de7\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") "
Jul 28 17:32:20.564360 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.564193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/07e2a171-286b-44fb-97ce-d1174e076de7-proxy-tls\") pod \"07e2a171-286b-44fb-97ce-d1174e076de7\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") "
Jul 28 17:32:20.564360 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.564241    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/07e2a171-286b-44fb-97ce-d1174e076de7-kube-rbac-proxy-sar-config\") pod \"07e2a171-286b-44fb-97ce-d1174e076de7\" (UID: \"07e2a171-286b-44fb-97ce-d1174e076de7\") "
Jul 28 17:32:20.564640 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.564605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e2a171-286b-44fb-97ce-d1174e076de7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "07e2a171-286b-44fb-97ce-d1174e076de7" (UID: "07e2a171-286b-44fb-97ce-d1174e076de7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:32:20.566334 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.566307    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e2a171-286b-44fb-97ce-d1174e076de7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "07e2a171-286b-44fb-97ce-d1174e076de7" (UID: "07e2a171-286b-44fb-97ce-d1174e076de7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:32:20.566416 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.566318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e2a171-286b-44fb-97ce-d1174e076de7-kube-api-access-cgps4" (OuterVolumeSpecName: "kube-api-access-cgps4") pod "07e2a171-286b-44fb-97ce-d1174e076de7" (UID: "07e2a171-286b-44fb-97ce-d1174e076de7"). InnerVolumeSpecName "kube-api-access-cgps4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:32:20.664939 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.664900    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/07e2a171-286b-44fb-97ce-d1174e076de7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:32:20.664939 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.664931    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgps4\" (UniqueName: \"kubernetes.io/projected/07e2a171-286b-44fb-97ce-d1174e076de7-kube-api-access-cgps4\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:32:20.664939 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.664947    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/07e2a171-286b-44fb-97ce-d1174e076de7-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:32:20.875353 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.875318    2579 generic.go:356] "Generic (PLEG): container finished" podID="07e2a171-286b-44fb-97ce-d1174e076de7" containerID="9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605" exitCode=0
Jul 28 17:32:20.875545 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.875377    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"
Jul 28 17:32:20.875545 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.875410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" event={"ID":"07e2a171-286b-44fb-97ce-d1174e076de7","Type":"ContainerDied","Data":"9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605"}
Jul 28 17:32:20.875545 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.875484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4" event={"ID":"07e2a171-286b-44fb-97ce-d1174e076de7","Type":"ContainerDied","Data":"102b258bceb8ce3f1e391dead75bd18cd160f3e70ee805991d28df972f2615f1"}
Jul 28 17:32:20.875545 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.875522    2579 scope.go:117] "RemoveContainer" containerID="c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac"
Jul 28 17:32:20.883795 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.883779    2579 scope.go:117] "RemoveContainer" containerID="9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605"
Jul 28 17:32:20.891828 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.891809    2579 scope.go:117] "RemoveContainer" containerID="c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac"
Jul 28 17:32:20.892079 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:32:20.892060    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac\": container with ID starting with c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac not found: ID does not exist" containerID="c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac"
Jul 28 17:32:20.892125 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.892087    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac"} err="failed to get container status \"c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac\": rpc error: code = NotFound desc = could not find container \"c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac\": container with ID starting with c3110900ea7a7a1bf0a17c6e01737e352dee83219a3cccfaf8b19050fd947dac not found: ID does not exist"
Jul 28 17:32:20.892125 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.892103    2579 scope.go:117] "RemoveContainer" containerID="9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605"
Jul 28 17:32:20.892382 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:32:20.892364    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605\": container with ID starting with 9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605 not found: ID does not exist" containerID="9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605"
Jul 28 17:32:20.892434 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.892387    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605"} err="failed to get container status \"9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605\": rpc error: code = NotFound desc = could not find container \"9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605\": container with ID starting with 9f4b5eace308d6cdfa4451acc6389b5e6e5de761165b8eaefc449930045d4605 not found: ID does not exist"
Jul 28 17:32:20.901816 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.901794    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"]
Jul 28 17:32:20.908111 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.908089    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-391b7-predictor-694d665486-h66x4"]
Jul 28 17:32:20.932073 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:20.932042    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" path="/var/lib/kubelet/pods/07e2a171-286b-44fb-97ce-d1174e076de7/volumes"
Jul 28 17:32:23.870532 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:23.870504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:32:23.870951 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:23.870926    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:32:33.871573 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:33.871531    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:32:43.871151 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:43.871104    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:32:53.871493 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:32:53.871404    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:33:03.872292 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:03.872241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:33:16.841872 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:16.841837    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"]
Jul 28 17:33:16.842289 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:16.842099    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" containerID="cri-o://aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21" gracePeriod=30
Jul 28 17:33:16.842289 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:16.842114    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kube-rbac-proxy" containerID="cri-o://6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958" gracePeriod=30
Jul 28 17:33:17.056064 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056023    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"]
Jul 28 17:33:17.056578 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056562    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container"
Jul 28 17:33:17.056635 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056582    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container"
Jul 28 17:33:17.056635 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056611    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kube-rbac-proxy"
Jul 28 17:33:17.056635 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056619    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kube-rbac-proxy"
Jul 28 17:33:17.056730 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056693    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kube-rbac-proxy"
Jul 28 17:33:17.056730 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.056707    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e2a171-286b-44fb-97ce-d1174e076de7" containerName="kserve-container"
Jul 28 17:33:17.060096 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.060078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.063175 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.063135    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ef873-predictor-serving-cert\""
Jul 28 17:33:17.063353 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.063175    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ef873-kube-rbac-proxy-sar-config\""
Jul 28 17:33:17.071899 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.071876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"]
Jul 28 17:33:17.130799 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.130764    2579 generic.go:356] "Generic (PLEG): container finished" podID="57c14be8-6f23-4efd-a099-ec50390dc451" containerID="6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958" exitCode=2
Jul 28 17:33:17.131006 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.130828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" event={"ID":"57c14be8-6f23-4efd-a099-ec50390dc451","Type":"ContainerDied","Data":"6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958"}
Jul 28 17:33:17.141430 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.141399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/53cdfbf0-e5fd-4e59-893c-43e83358704b-proxy-tls\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.141583 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.141438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxxpb\" (UniqueName: \"kubernetes.io/projected/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-api-access-vxxpb\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.141583 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.141472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.242242 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.242205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/53cdfbf0-e5fd-4e59-893c-43e83358704b-proxy-tls\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.242242 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.242256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxxpb\" (UniqueName: \"kubernetes.io/projected/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-api-access-vxxpb\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.242541 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.242311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.243072 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.243047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.245031 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.245007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/53cdfbf0-e5fd-4e59-893c-43e83358704b-proxy-tls\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.252032 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.252006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxxpb\" (UniqueName: \"kubernetes.io/projected/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-api-access-vxxpb\") pod \"error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") " pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.373030 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.372995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:17.510975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:17.510859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"]
Jul 28 17:33:17.513707 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:33:17.513682    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53cdfbf0_e5fd_4e59_893c_43e83358704b.slice/crio-9ead20633f47805d6408ca1a44633b5955cd1bfc474c996836fa06927d382da7 WatchSource:0}: Error finding container 9ead20633f47805d6408ca1a44633b5955cd1bfc474c996836fa06927d382da7: Status 404 returned error can't find the container with id 9ead20633f47805d6408ca1a44633b5955cd1bfc474c996836fa06927d382da7
Jul 28 17:33:18.137197 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:18.137155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" event={"ID":"53cdfbf0-e5fd-4e59-893c-43e83358704b","Type":"ContainerStarted","Data":"3257b39ed93135dbbfc4177a4613e3d2cce6998c3f63f69c59b58da68ec73c6b"}
Jul 28 17:33:18.137578 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:18.137219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" event={"ID":"53cdfbf0-e5fd-4e59-893c-43e83358704b","Type":"ContainerStarted","Data":"663e0ecbbf5c076c256f1d947193025e150ebd086c06e3ad0eff51efb5639fbe"}
Jul 28 17:33:18.137578 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:18.137247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" event={"ID":"53cdfbf0-e5fd-4e59-893c-43e83358704b","Type":"ContainerStarted","Data":"9ead20633f47805d6408ca1a44633b5955cd1bfc474c996836fa06927d382da7"}
Jul 28 17:33:18.137578 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:18.137328    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:18.158879 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:18.158816    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podStartSLOduration=1.158799377 podStartE2EDuration="1.158799377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:33:18.157008537 +0000 UTC m=+1463.830961480" watchObservedRunningTime="2026-07-28 17:33:18.158799377 +0000 UTC m=+1463.832752322"
Jul 28 17:33:19.142299 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:19.142247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:19.143598 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:19.143561    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 28 17:33:19.635514 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:19.635466    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused"
Jul 28 17:33:19.639913 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:19.639878    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused"
Jul 28 17:33:20.098552 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.098525    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:33:20.149639 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.149603    2579 generic.go:356] "Generic (PLEG): container finished" podID="57c14be8-6f23-4efd-a099-ec50390dc451" containerID="aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21" exitCode=0
Jul 28 17:33:20.150110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.149659    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"
Jul 28 17:33:20.150110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.149698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" event={"ID":"57c14be8-6f23-4efd-a099-ec50390dc451","Type":"ContainerDied","Data":"aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21"}
Jul 28 17:33:20.150110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.149756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7" event={"ID":"57c14be8-6f23-4efd-a099-ec50390dc451","Type":"ContainerDied","Data":"23d98b18efd167c6fa3e9e5d84609194df30aced947c49d1d35107977167df04"}
Jul 28 17:33:20.150110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.149784    2579 scope.go:117] "RemoveContainer" containerID="6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958"
Jul 28 17:33:20.150338 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.150166    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 28 17:33:20.158546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.158527    2579 scope.go:117] "RemoveContainer" containerID="aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21"
Jul 28 17:33:20.165759 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.165737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57c14be8-6f23-4efd-a099-ec50390dc451-proxy-tls\") pod \"57c14be8-6f23-4efd-a099-ec50390dc451\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") "
Jul 28 17:33:20.165891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.165771    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57c14be8-6f23-4efd-a099-ec50390dc451-kube-rbac-proxy-sar-config\") pod \"57c14be8-6f23-4efd-a099-ec50390dc451\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") "
Jul 28 17:33:20.165891 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.165805    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn66q\" (UniqueName: \"kubernetes.io/projected/57c14be8-6f23-4efd-a099-ec50390dc451-kube-api-access-tn66q\") pod \"57c14be8-6f23-4efd-a099-ec50390dc451\" (UID: \"57c14be8-6f23-4efd-a099-ec50390dc451\") "
Jul 28 17:33:20.166168 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.166133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c14be8-6f23-4efd-a099-ec50390dc451-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "57c14be8-6f23-4efd-a099-ec50390dc451" (UID: "57c14be8-6f23-4efd-a099-ec50390dc451"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:33:20.166583 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.166560    2579 scope.go:117] "RemoveContainer" containerID="6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958"
Jul 28 17:33:20.166886 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:33:20.166860    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958\": container with ID starting with 6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958 not found: ID does not exist" containerID="6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958"
Jul 28 17:33:20.166959 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.166899    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958"} err="failed to get container status \"6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958\": rpc error: code = NotFound desc = could not find container \"6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958\": container with ID starting with 6ad6faeba2c0b9c6f6357686c00034b741e09c3a6681142ce37a8831b50e4958 not found: ID does not exist"
Jul 28 17:33:20.166959 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.166923    2579 scope.go:117] "RemoveContainer" containerID="aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21"
Jul 28 17:33:20.167150 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:33:20.167126    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21\": container with ID starting with aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21 not found: ID does not exist" containerID="aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21"
Jul 28 17:33:20.167198 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.167159    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21"} err="failed to get container status \"aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21\": rpc error: code = NotFound desc = could not find container \"aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21\": container with ID starting with aa2d3d27c9c9dfa519b76efaad088300a1d278f6ee1b11675b6b258c54a45a21 not found: ID does not exist"
Jul 28 17:33:20.167913 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.167891    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c14be8-6f23-4efd-a099-ec50390dc451-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "57c14be8-6f23-4efd-a099-ec50390dc451" (UID: "57c14be8-6f23-4efd-a099-ec50390dc451"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:33:20.167993 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.167974    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c14be8-6f23-4efd-a099-ec50390dc451-kube-api-access-tn66q" (OuterVolumeSpecName: "kube-api-access-tn66q") pod "57c14be8-6f23-4efd-a099-ec50390dc451" (UID: "57c14be8-6f23-4efd-a099-ec50390dc451"). InnerVolumeSpecName "kube-api-access-tn66q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:33:20.266902 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.266817    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57c14be8-6f23-4efd-a099-ec50390dc451-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:33:20.266902 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.266850    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57c14be8-6f23-4efd-a099-ec50390dc451-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:33:20.266902 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.266860    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn66q\" (UniqueName: \"kubernetes.io/projected/57c14be8-6f23-4efd-a099-ec50390dc451-kube-api-access-tn66q\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:33:20.472181 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.472146    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"]
Jul 28 17:33:20.476311 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.476286    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-211cd-predictor-7596487544-mvkc7"]
Jul 28 17:33:20.932359 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:20.932326    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" path="/var/lib/kubelet/pods/57c14be8-6f23-4efd-a099-ec50390dc451/volumes"
Jul 28 17:33:25.154128 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:25.154098    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:33:25.154661 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:25.154630    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 28 17:33:31.296945 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.296912    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"]
Jul 28 17:33:31.297364 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.297157    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" containerID="cri-o://366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1" gracePeriod=30
Jul 28 17:33:31.297364 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.297201    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kube-rbac-proxy" containerID="cri-o://464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1" gracePeriod=30
Jul 28 17:33:31.496560 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.496521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"]
Jul 28 17:33:31.496935 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.496917    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container"
Jul 28 17:33:31.497027 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.496937    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container"
Jul 28 17:33:31.497027 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.496949    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kube-rbac-proxy"
Jul 28 17:33:31.497027 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.496956    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kube-rbac-proxy"
Jul 28 17:33:31.497027 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.497007    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kube-rbac-proxy"
Jul 28 17:33:31.497027 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.497015    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c14be8-6f23-4efd-a099-ec50390dc451" containerName="kserve-container"
Jul 28 17:33:31.500138 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.500120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.503007 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.502979    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-d1fc0-predictor-serving-cert\""
Jul 28 17:33:31.503122 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.502990    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-d1fc0-kube-rbac-proxy-sar-config\""
Jul 28 17:33:31.509676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.509651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"]
Jul 28 17:33:31.563450 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.563356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.563450 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.563447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q957p\" (UniqueName: \"kubernetes.io/projected/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-api-access-q957p\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.563630 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.563494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50e675ef-4e44-42ea-87c8-fd22be665c28-proxy-tls\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.664477 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.664438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q957p\" (UniqueName: \"kubernetes.io/projected/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-api-access-q957p\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.664681 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.664488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50e675ef-4e44-42ea-87c8-fd22be665c28-proxy-tls\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.664681 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.664524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.665178 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.665154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.666939 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.666916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50e675ef-4e44-42ea-87c8-fd22be665c28-proxy-tls\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.672864 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.672841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q957p\" (UniqueName: \"kubernetes.io/projected/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-api-access-q957p\") pod \"error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") " pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.811030 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.810978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:31.946111 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:31.946084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"]
Jul 28 17:33:31.948135 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:33:31.948106    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e675ef_4e44_42ea_87c8_fd22be665c28.slice/crio-cf3ce0809d2c8d79ec34cdfd758c4d5d6712a904c03956cfb22084e67ce2a12c WatchSource:0}: Error finding container cf3ce0809d2c8d79ec34cdfd758c4d5d6712a904c03956cfb22084e67ce2a12c: Status 404 returned error can't find the container with id cf3ce0809d2c8d79ec34cdfd758c4d5d6712a904c03956cfb22084e67ce2a12c
Jul 28 17:33:32.209156 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.209123    2579 generic.go:356] "Generic (PLEG): container finished" podID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerID="464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1" exitCode=2
Jul 28 17:33:32.209357 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.209184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" event={"ID":"6be7aedd-9954-40f7-a018-8d36a99b4f71","Type":"ContainerDied","Data":"464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1"}
Jul 28 17:33:32.210991 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.210964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" event={"ID":"50e675ef-4e44-42ea-87c8-fd22be665c28","Type":"ContainerStarted","Data":"0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df"}
Jul 28 17:33:32.211118 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.211018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" event={"ID":"50e675ef-4e44-42ea-87c8-fd22be665c28","Type":"ContainerStarted","Data":"8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5"}
Jul 28 17:33:32.211118 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.211051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:32.211118 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.211071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" event={"ID":"50e675ef-4e44-42ea-87c8-fd22be665c28","Type":"ContainerStarted","Data":"cf3ce0809d2c8d79ec34cdfd758c4d5d6712a904c03956cfb22084e67ce2a12c"}
Jul 28 17:33:32.234731 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:32.234684    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podStartSLOduration=1.234669668 podStartE2EDuration="1.234669668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:33:32.233107819 +0000 UTC m=+1477.907060776" watchObservedRunningTime="2026-07-28 17:33:32.234669668 +0000 UTC m=+1477.908622612"
Jul 28 17:33:33.215367 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:33.215334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:33.216785 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:33.216759    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:33:33.865623 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:33.865579    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused"
Jul 28 17:33:33.870946 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:33.870913    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 17:33:34.219512 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.219422    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:33:34.547666 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.547638    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:33:34.590475 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.590441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-rbac-proxy-sar-config\") pod \"6be7aedd-9954-40f7-a018-8d36a99b4f71\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") "
Jul 28 17:33:34.590604 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.590531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lghnf\" (UniqueName: \"kubernetes.io/projected/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-api-access-lghnf\") pod \"6be7aedd-9954-40f7-a018-8d36a99b4f71\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") "
Jul 28 17:33:34.590604 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.590582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6be7aedd-9954-40f7-a018-8d36a99b4f71-proxy-tls\") pod \"6be7aedd-9954-40f7-a018-8d36a99b4f71\" (UID: \"6be7aedd-9954-40f7-a018-8d36a99b4f71\") "
Jul 28 17:33:34.590838 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.590811    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "6be7aedd-9954-40f7-a018-8d36a99b4f71" (UID: "6be7aedd-9954-40f7-a018-8d36a99b4f71"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:33:34.592645 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.592617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-api-access-lghnf" (OuterVolumeSpecName: "kube-api-access-lghnf") pod "6be7aedd-9954-40f7-a018-8d36a99b4f71" (UID: "6be7aedd-9954-40f7-a018-8d36a99b4f71"). InnerVolumeSpecName "kube-api-access-lghnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:33:34.592752 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.592652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6be7aedd-9954-40f7-a018-8d36a99b4f71-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6be7aedd-9954-40f7-a018-8d36a99b4f71" (UID: "6be7aedd-9954-40f7-a018-8d36a99b4f71"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:33:34.691562 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.691525    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lghnf\" (UniqueName: \"kubernetes.io/projected/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-api-access-lghnf\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:33:34.691562 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.691557    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6be7aedd-9954-40f7-a018-8d36a99b4f71-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:33:34.691562 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:34.691567    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6be7aedd-9954-40f7-a018-8d36a99b4f71-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:33:35.154855 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.154819    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 28 17:33:35.224811 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.224715    2579 generic.go:356] "Generic (PLEG): container finished" podID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerID="366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1" exitCode=0
Jul 28 17:33:35.224811 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.224767    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"
Jul 28 17:33:35.224811 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.224801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" event={"ID":"6be7aedd-9954-40f7-a018-8d36a99b4f71","Type":"ContainerDied","Data":"366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1"}
Jul 28 17:33:35.225352 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.224860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj" event={"ID":"6be7aedd-9954-40f7-a018-8d36a99b4f71","Type":"ContainerDied","Data":"6cf203e718a6152fd7c5fc7477fd217f78aef871f9479d6ce6185940b5937f25"}
Jul 28 17:33:35.225352 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.224889    2579 scope.go:117] "RemoveContainer" containerID="464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1"
Jul 28 17:33:35.233348 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.233329    2579 scope.go:117] "RemoveContainer" containerID="366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1"
Jul 28 17:33:35.240975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.240958    2579 scope.go:117] "RemoveContainer" containerID="464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1"
Jul 28 17:33:35.241330 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:33:35.241305    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1\": container with ID starting with 464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1 not found: ID does not exist" containerID="464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1"
Jul 28 17:33:35.241444 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.241340    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1"} err="failed to get container status \"464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1\": rpc error: code = NotFound desc = could not find container \"464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1\": container with ID starting with 464ed6b56e6792ec5d33d60e07ea61027c9d1c5ec6d2513833fd494989fb50b1 not found: ID does not exist"
Jul 28 17:33:35.241444 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.241360    2579 scope.go:117] "RemoveContainer" containerID="366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1"
Jul 28 17:33:35.241628 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:33:35.241612    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1\": container with ID starting with 366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1 not found: ID does not exist" containerID="366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1"
Jul 28 17:33:35.241664 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.241633    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1"} err="failed to get container status \"366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1\": rpc error: code = NotFound desc = could not find container \"366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1\": container with ID starting with 366e0bb4721d963ff1f2df3fc2fdd2b37f6681ecb98835a57ecc22b3de5311d1 not found: ID does not exist"
Jul 28 17:33:35.254727 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.254700    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"]
Jul 28 17:33:35.256196 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:35.256171    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a23a-predictor-6b5bbf5776-rnjsj"]
Jul 28 17:33:36.931859 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:36.931817    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" path="/var/lib/kubelet/pods/6be7aedd-9954-40f7-a018-8d36a99b4f71/volumes"
Jul 28 17:33:39.223824 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:39.223796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:33:39.224428 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:39.224402    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:33:45.155419 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:45.155372    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 28 17:33:49.224484 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:49.224445    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:33:54.865618 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:54.865588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:33:54.868582 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:54.868552    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:33:55.155075 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:55.154991    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused"
Jul 28 17:33:59.224352 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:33:59.224309    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:34:05.155916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:05.155885    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:34:09.225133 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:09.225090    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:34:19.225972 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:19.225891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:34:27.187110 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.187076    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"]
Jul 28 17:34:27.187657 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.187414    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container" containerID="cri-o://663e0ecbbf5c076c256f1d947193025e150ebd086c06e3ad0eff51efb5639fbe" gracePeriod=30
Jul 28 17:34:27.187657 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.187477    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kube-rbac-proxy" containerID="cri-o://3257b39ed93135dbbfc4177a4613e3d2cce6998c3f63f69c59b58da68ec73c6b" gracePeriod=30
Jul 28 17:34:27.373138 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373102    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"]
Jul 28 17:34:27.373490 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373476    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kube-rbac-proxy"
Jul 28 17:34:27.373542 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373492    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kube-rbac-proxy"
Jul 28 17:34:27.373542 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373512    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container"
Jul 28 17:34:27.373542 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373518    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container"
Jul 28 17:34:27.373632 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373583    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kube-rbac-proxy"
Jul 28 17:34:27.373632 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.373593    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be7aedd-9954-40f7-a018-8d36a99b4f71" containerName="kserve-container"
Jul 28 17:34:27.376510 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.376494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.379355 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.379336    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-a513a-predictor-serving-cert\""
Jul 28 17:34:27.379526 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.379511    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-a513a-kube-rbac-proxy-sar-config\""
Jul 28 17:34:27.387477 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.387457    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"]
Jul 28 17:34:27.438281 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.438126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.438281 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.438186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a3f004e1-2f43-487a-9288-3d83749b7295-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.438281 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.438208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjkt\" (UniqueName: \"kubernetes.io/projected/a3f004e1-2f43-487a-9288-3d83749b7295-kube-api-access-jxjkt\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.479229 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.479201    2579 generic.go:356] "Generic (PLEG): container finished" podID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerID="3257b39ed93135dbbfc4177a4613e3d2cce6998c3f63f69c59b58da68ec73c6b" exitCode=2
Jul 28 17:34:27.479409 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.479256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" event={"ID":"53cdfbf0-e5fd-4e59-893c-43e83358704b","Type":"ContainerDied","Data":"3257b39ed93135dbbfc4177a4613e3d2cce6998c3f63f69c59b58da68ec73c6b"}
Jul 28 17:34:27.538797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.538761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a3f004e1-2f43-487a-9288-3d83749b7295-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.538797 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.538800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjkt\" (UniqueName: \"kubernetes.io/projected/a3f004e1-2f43-487a-9288-3d83749b7295-kube-api-access-jxjkt\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.539039 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.538857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.539039 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:34:27.538965    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-a513a-predictor-serving-cert: secret "error-404-isvc-a513a-predictor-serving-cert" not found
Jul 28 17:34:27.539039 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:34:27.539035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls podName:a3f004e1-2f43-487a-9288-3d83749b7295 nodeName:}" failed. No retries permitted until 2026-07-28 17:34:28.039015426 +0000 UTC m=+1533.712968365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls") pod "error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" (UID: "a3f004e1-2f43-487a-9288-3d83749b7295") : secret "error-404-isvc-a513a-predictor-serving-cert" not found
Jul 28 17:34:27.539524 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.539500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a3f004e1-2f43-487a-9288-3d83749b7295-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:27.548217 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:27.548184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjkt\" (UniqueName: \"kubernetes.io/projected/a3f004e1-2f43-487a-9288-3d83749b7295-kube-api-access-jxjkt\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:28.043536 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:28.043491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:28.045901 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:28.045878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls\") pod \"error-404-isvc-a513a-predictor-d745bdcc6-9xwj8\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") " pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:28.288540 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:28.288482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:28.421099 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:28.421065    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"]
Jul 28 17:34:28.424794 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:34:28.424761    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f004e1_2f43_487a_9288_3d83749b7295.slice/crio-4e719b2b0631abea4e90370ecd67f3424ce46511f7b00050291a9f7d3ad2f8b5 WatchSource:0}: Error finding container 4e719b2b0631abea4e90370ecd67f3424ce46511f7b00050291a9f7d3ad2f8b5: Status 404 returned error can't find the container with id 4e719b2b0631abea4e90370ecd67f3424ce46511f7b00050291a9f7d3ad2f8b5
Jul 28 17:34:28.485809 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:28.485779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" event={"ID":"a3f004e1-2f43-487a-9288-3d83749b7295","Type":"ContainerStarted","Data":"39a66fac8cd9d39cf2783a329c434d242d69dbc2643e4cdb4cbca8b6d6eb9593"}
Jul 28 17:34:28.485915 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:28.485846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" event={"ID":"a3f004e1-2f43-487a-9288-3d83749b7295","Type":"ContainerStarted","Data":"4e719b2b0631abea4e90370ecd67f3424ce46511f7b00050291a9f7d3ad2f8b5"}
Jul 28 17:34:29.492659 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:29.492618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" event={"ID":"a3f004e1-2f43-487a-9288-3d83749b7295","Type":"ContainerStarted","Data":"84aec5730ecede2255e59916930b0a4c130d5f0a5528000c8eb8ea1876bb72f6"}
Jul 28 17:34:29.493041 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:29.492790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:29.493041 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:29.492829    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:29.494023 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:29.493998    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 28 17:34:29.512161 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:29.512113    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podStartSLOduration=2.5120947449999997 podStartE2EDuration="2.512094745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:34:29.510137155 +0000 UTC m=+1535.184090100" watchObservedRunningTime="2026-07-28 17:34:29.512094745 +0000 UTC m=+1535.186047690"
Jul 28 17:34:30.150846 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.150806    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.29:8643/healthz\": dial tcp 10.133.0.29:8643: connect: connection refused"
Jul 28 17:34:30.499692 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.499657    2579 generic.go:356] "Generic (PLEG): container finished" podID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerID="663e0ecbbf5c076c256f1d947193025e150ebd086c06e3ad0eff51efb5639fbe" exitCode=0
Jul 28 17:34:30.500165 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.499725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" event={"ID":"53cdfbf0-e5fd-4e59-893c-43e83358704b","Type":"ContainerDied","Data":"663e0ecbbf5c076c256f1d947193025e150ebd086c06e3ad0eff51efb5639fbe"}
Jul 28 17:34:30.500165 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.500042    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 28 17:34:30.537538 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.537517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:34:30.666433 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.666334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-rbac-proxy-sar-config\") pod \"53cdfbf0-e5fd-4e59-893c-43e83358704b\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") "
Jul 28 17:34:30.666433 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.666380    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxxpb\" (UniqueName: \"kubernetes.io/projected/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-api-access-vxxpb\") pod \"53cdfbf0-e5fd-4e59-893c-43e83358704b\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") "
Jul 28 17:34:30.666683 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.666457    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/53cdfbf0-e5fd-4e59-893c-43e83358704b-proxy-tls\") pod \"53cdfbf0-e5fd-4e59-893c-43e83358704b\" (UID: \"53cdfbf0-e5fd-4e59-893c-43e83358704b\") "
Jul 28 17:34:30.666758 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.666730    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "53cdfbf0-e5fd-4e59-893c-43e83358704b" (UID: "53cdfbf0-e5fd-4e59-893c-43e83358704b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:34:30.668545 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.668512    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cdfbf0-e5fd-4e59-893c-43e83358704b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "53cdfbf0-e5fd-4e59-893c-43e83358704b" (UID: "53cdfbf0-e5fd-4e59-893c-43e83358704b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:34:30.668670 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.668623    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-api-access-vxxpb" (OuterVolumeSpecName: "kube-api-access-vxxpb") pod "53cdfbf0-e5fd-4e59-893c-43e83358704b" (UID: "53cdfbf0-e5fd-4e59-893c-43e83358704b"). InnerVolumeSpecName "kube-api-access-vxxpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:34:30.767695 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.767651    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/53cdfbf0-e5fd-4e59-893c-43e83358704b-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:34:30.767695 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.767687    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:34:30.767695 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:30.767701    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxxpb\" (UniqueName: \"kubernetes.io/projected/53cdfbf0-e5fd-4e59-893c-43e83358704b-kube-api-access-vxxpb\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:34:31.505801 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:31.505770    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"
Jul 28 17:34:31.505801 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:31.505784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb" event={"ID":"53cdfbf0-e5fd-4e59-893c-43e83358704b","Type":"ContainerDied","Data":"9ead20633f47805d6408ca1a44633b5955cd1bfc474c996836fa06927d382da7"}
Jul 28 17:34:31.506289 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:31.505859    2579 scope.go:117] "RemoveContainer" containerID="3257b39ed93135dbbfc4177a4613e3d2cce6998c3f63f69c59b58da68ec73c6b"
Jul 28 17:34:31.514211 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:31.514189    2579 scope.go:117] "RemoveContainer" containerID="663e0ecbbf5c076c256f1d947193025e150ebd086c06e3ad0eff51efb5639fbe"
Jul 28 17:34:31.524319 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:31.524298    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"]
Jul 28 17:34:31.526551 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:31.526527    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ef873-predictor-6bdbb99f4d-plzsb"]
Jul 28 17:34:32.933222 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:32.933184    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" path="/var/lib/kubelet/pods/53cdfbf0-e5fd-4e59-893c-43e83358704b/volumes"
Jul 28 17:34:35.504583 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:35.504555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:34:35.504964 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:35.504914    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 28 17:34:45.505516 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:45.505473    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 28 17:34:55.505056 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:34:55.505015    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 28 17:35:05.505537 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:35:05.505493    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused"
Jul 28 17:35:15.506566 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:35:15.506536    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:38:54.893658 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:38:54.893619    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:38:54.897602 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:38:54.897577    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:42:46.287711 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.287679    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"]
Jul 28 17:42:46.328629 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.328599    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"]
Jul 28 17:42:46.329092 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.329079    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kube-rbac-proxy"
Jul 28 17:42:46.329145 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.329096    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kube-rbac-proxy"
Jul 28 17:42:46.329145 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.329133    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container"
Jul 28 17:42:46.329145 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.329143    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container"
Jul 28 17:42:46.329250 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.329214    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kube-rbac-proxy"
Jul 28 17:42:46.329250 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.329226    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cdfbf0-e5fd-4e59-893c-43e83358704b" containerName="kserve-container"
Jul 28 17:42:46.332644 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.332622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.335382 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.335356    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-11994-predictor-serving-cert\""
Jul 28 17:42:46.335514 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.335440    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-11994-kube-rbac-proxy-sar-config\""
Jul 28 17:42:46.342444 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.342422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"]
Jul 28 17:42:46.429637 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.429606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nqnt\" (UniqueName: \"kubernetes.io/projected/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-api-access-6nqnt\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.429759 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.429660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.429759 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.429700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.530256 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.530233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nqnt\" (UniqueName: \"kubernetes.io/projected/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-api-access-6nqnt\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.530394 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.530293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.530394 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.530333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.530514 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:42:46.530461    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-11994-predictor-serving-cert: secret "error-404-isvc-11994-predictor-serving-cert" not found
Jul 28 17:42:46.530555 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:42:46.530549    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls podName:470a255e-f2cb-4500-8b66-5d4e26766e9e nodeName:}" failed. No retries permitted until 2026-07-28 17:42:47.030529488 +0000 UTC m=+2032.704482425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls") pod "error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" (UID: "470a255e-f2cb-4500-8b66-5d4e26766e9e") : secret "error-404-isvc-11994-predictor-serving-cert" not found
Jul 28 17:42:46.531024 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.531005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.539988 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.539935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nqnt\" (UniqueName: \"kubernetes.io/projected/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-api-access-6nqnt\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:46.756836 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.756793    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" containerID="cri-o://8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5" gracePeriod=30
Jul 28 17:42:46.756836 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:46.756819    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kube-rbac-proxy" containerID="cri-o://0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df" gracePeriod=30
Jul 28 17:42:47.035660 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.035625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:47.037980 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.037949    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls\") pod \"error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") " pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:47.242905 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.242814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:47.369046 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.369021    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"]
Jul 28 17:42:47.370403 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:42:47.370376    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470a255e_f2cb_4500_8b66_5d4e26766e9e.slice/crio-849fdb9a49f5be7d51808fb1ed9730a0db66631e6a6800e060079476f370692d WatchSource:0}: Error finding container 849fdb9a49f5be7d51808fb1ed9730a0db66631e6a6800e060079476f370692d: Status 404 returned error can't find the container with id 849fdb9a49f5be7d51808fb1ed9730a0db66631e6a6800e060079476f370692d
Jul 28 17:42:47.762575 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.762533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" event={"ID":"470a255e-f2cb-4500-8b66-5d4e26766e9e","Type":"ContainerStarted","Data":"ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32"}
Jul 28 17:42:47.762747 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.762603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" event={"ID":"470a255e-f2cb-4500-8b66-5d4e26766e9e","Type":"ContainerStarted","Data":"21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4"}
Jul 28 17:42:47.762747 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.762626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" event={"ID":"470a255e-f2cb-4500-8b66-5d4e26766e9e","Type":"ContainerStarted","Data":"849fdb9a49f5be7d51808fb1ed9730a0db66631e6a6800e060079476f370692d"}
Jul 28 17:42:47.762747 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.762661    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:47.764297 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.764251    2579 generic.go:356] "Generic (PLEG): container finished" podID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerID="0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df" exitCode=2
Jul 28 17:42:47.764297 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.764289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" event={"ID":"50e675ef-4e44-42ea-87c8-fd22be665c28","Type":"ContainerDied","Data":"0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df"}
Jul 28 17:42:47.784659 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:47.784616    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podStartSLOduration=1.784602466 podStartE2EDuration="1.784602466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:42:47.782970694 +0000 UTC m=+2033.456923651" watchObservedRunningTime="2026-07-28 17:42:47.784602466 +0000 UTC m=+2033.458555410"
Jul 28 17:42:48.769787 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:48.769759    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:48.771016 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:48.770987    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 28 17:42:49.219919 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.219876    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused"
Jul 28 17:42:49.224569 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.224544    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused"
Jul 28 17:42:49.695893 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.695871    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:42:49.762278 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.762251    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50e675ef-4e44-42ea-87c8-fd22be665c28-proxy-tls\") pod \"50e675ef-4e44-42ea-87c8-fd22be665c28\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") "
Jul 28 17:42:49.762431 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.762320    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-rbac-proxy-sar-config\") pod \"50e675ef-4e44-42ea-87c8-fd22be665c28\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") "
Jul 28 17:42:49.762431 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.762366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q957p\" (UniqueName: \"kubernetes.io/projected/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-api-access-q957p\") pod \"50e675ef-4e44-42ea-87c8-fd22be665c28\" (UID: \"50e675ef-4e44-42ea-87c8-fd22be665c28\") "
Jul 28 17:42:49.762659 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.762628    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "50e675ef-4e44-42ea-87c8-fd22be665c28" (UID: "50e675ef-4e44-42ea-87c8-fd22be665c28"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:42:49.764322 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.764298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-api-access-q957p" (OuterVolumeSpecName: "kube-api-access-q957p") pod "50e675ef-4e44-42ea-87c8-fd22be665c28" (UID: "50e675ef-4e44-42ea-87c8-fd22be665c28"). InnerVolumeSpecName "kube-api-access-q957p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:42:49.764420 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.764400    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e675ef-4e44-42ea-87c8-fd22be665c28-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "50e675ef-4e44-42ea-87c8-fd22be665c28" (UID: "50e675ef-4e44-42ea-87c8-fd22be665c28"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:42:49.776688 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.776663    2579 generic.go:356] "Generic (PLEG): container finished" podID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerID="8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5" exitCode=0
Jul 28 17:42:49.776975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.776709    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"
Jul 28 17:42:49.776975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.776751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" event={"ID":"50e675ef-4e44-42ea-87c8-fd22be665c28","Type":"ContainerDied","Data":"8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5"}
Jul 28 17:42:49.776975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.776806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm" event={"ID":"50e675ef-4e44-42ea-87c8-fd22be665c28","Type":"ContainerDied","Data":"cf3ce0809d2c8d79ec34cdfd758c4d5d6712a904c03956cfb22084e67ce2a12c"}
Jul 28 17:42:49.776975 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.776833    2579 scope.go:117] "RemoveContainer" containerID="0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df"
Jul 28 17:42:49.777416 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.777387    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 28 17:42:49.785407 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.785391    2579 scope.go:117] "RemoveContainer" containerID="8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5"
Jul 28 17:42:49.792451 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.792427    2579 scope.go:117] "RemoveContainer" containerID="0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df"
Jul 28 17:42:49.792680 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:42:49.792662    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df\": container with ID starting with 0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df not found: ID does not exist" containerID="0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df"
Jul 28 17:42:49.792729 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.792688    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df"} err="failed to get container status \"0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df\": rpc error: code = NotFound desc = could not find container \"0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df\": container with ID starting with 0c01705ad60e017c64665d723bcd3e467a6dbc3c479cd856032e57b4d45717df not found: ID does not exist"
Jul 28 17:42:49.792729 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.792703    2579 scope.go:117] "RemoveContainer" containerID="8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5"
Jul 28 17:42:49.792922 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:42:49.792908    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5\": container with ID starting with 8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5 not found: ID does not exist" containerID="8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5"
Jul 28 17:42:49.792962 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.792926    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5"} err="failed to get container status \"8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5\": rpc error: code = NotFound desc = could not find container \"8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5\": container with ID starting with 8621b95b516707f893878923a23aaf16810673c5cd02c3c71af1aa677aad45a5 not found: ID does not exist"
Jul 28 17:42:49.801309 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.801288    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"]
Jul 28 17:42:49.802732 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.802715    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-d1fc0-predictor-8b6dd7598-fsjtm"]
Jul 28 17:42:49.863528 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.863510    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50e675ef-4e44-42ea-87c8-fd22be665c28-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:42:49.863651 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.863532    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:42:49.863651 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:49.863547    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q957p\" (UniqueName: \"kubernetes.io/projected/50e675ef-4e44-42ea-87c8-fd22be665c28-kube-api-access-q957p\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:42:50.931779 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:50.931747    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" path="/var/lib/kubelet/pods/50e675ef-4e44-42ea-87c8-fd22be665c28/volumes"
Jul 28 17:42:54.782073 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:54.782046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:42:54.782496 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:42:54.782451    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 28 17:43:04.783161 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:04.783111    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 28 17:43:14.782634 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:14.782594    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 28 17:43:24.783509 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:24.783430    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 28 17:43:34.783949 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:34.783910    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:43:42.044564 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.044530    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"]
Jul 28 17:43:42.045046 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.044742    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container" containerID="cri-o://39a66fac8cd9d39cf2783a329c434d242d69dbc2643e4cdb4cbca8b6d6eb9593" gracePeriod=30
Jul 28 17:43:42.045046 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.044794    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kube-rbac-proxy" containerID="cri-o://84aec5730ecede2255e59916930b0a4c130d5f0a5528000c8eb8ea1876bb72f6" gracePeriod=30
Jul 28 17:43:42.286532 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.286492    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"]
Jul 28 17:43:42.286943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.286923    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container"
Jul 28 17:43:42.286943 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.286941    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container"
Jul 28 17:43:42.287114 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.286966    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kube-rbac-proxy"
Jul 28 17:43:42.287114 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.286971    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kube-rbac-proxy"
Jul 28 17:43:42.287114 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.287020    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kube-rbac-proxy"
Jul 28 17:43:42.287114 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.287030    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e675ef-4e44-42ea-87c8-fd22be665c28" containerName="kserve-container"
Jul 28 17:43:42.289993 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.289965    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.292816 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.292795    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0dc16-predictor-serving-cert\""
Jul 28 17:43:42.293097 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.293076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0dc16-kube-rbac-proxy-sar-config\""
Jul 28 17:43:42.301684 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.301660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"]
Jul 28 17:43:42.366163 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.366132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.366365 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.366217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9kp9\" (UniqueName: \"kubernetes.io/projected/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-api-access-p9kp9\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.366365 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.366257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.467040 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.467004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9kp9\" (UniqueName: \"kubernetes.io/projected/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-api-access-p9kp9\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.467252 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.467043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.467252 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.467075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.467252 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:43:42.467189    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-serving-cert: secret "error-404-isvc-0dc16-predictor-serving-cert" not found
Jul 28 17:43:42.467467 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:43:42.467296    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls podName:2324128f-28ce-4991-aaa2-03ce64f72e72 nodeName:}" failed. No retries permitted until 2026-07-28 17:43:42.967252471 +0000 UTC m=+2088.641205400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls") pod "error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" (UID: "2324128f-28ce-4991-aaa2-03ce64f72e72") : secret "error-404-isvc-0dc16-predictor-serving-cert" not found
Jul 28 17:43:42.467684 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.467667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.476213 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.476190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9kp9\" (UniqueName: \"kubernetes.io/projected/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-api-access-p9kp9\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.970890 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.970850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:42.973210 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:42.973189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls\") pod \"error-404-isvc-0dc16-predictor-6b9b847f98-nskqq\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") " pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:43.009464 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:43.009437    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3f004e1-2f43-487a-9288-3d83749b7295" containerID="84aec5730ecede2255e59916930b0a4c130d5f0a5528000c8eb8ea1876bb72f6" exitCode=2
Jul 28 17:43:43.009559 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:43.009508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" event={"ID":"a3f004e1-2f43-487a-9288-3d83749b7295","Type":"ContainerDied","Data":"84aec5730ecede2255e59916930b0a4c130d5f0a5528000c8eb8ea1876bb72f6"}
Jul 28 17:43:43.212151 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:43.212127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:43.340215 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:43.340183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"]
Jul 28 17:43:43.341390 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:43:43.341349    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2324128f_28ce_4991_aaa2_03ce64f72e72.slice/crio-78f25cb8791edaf107700cdbedc9a22ae0f677c6d2505217a9a4fe96e490a145 WatchSource:0}: Error finding container 78f25cb8791edaf107700cdbedc9a22ae0f677c6d2505217a9a4fe96e490a145: Status 404 returned error can't find the container with id 78f25cb8791edaf107700cdbedc9a22ae0f677c6d2505217a9a4fe96e490a145
Jul 28 17:43:44.015491 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:44.015448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" event={"ID":"2324128f-28ce-4991-aaa2-03ce64f72e72","Type":"ContainerStarted","Data":"941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41"}
Jul 28 17:43:44.015676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:44.015515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" event={"ID":"2324128f-28ce-4991-aaa2-03ce64f72e72","Type":"ContainerStarted","Data":"cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8"}
Jul 28 17:43:44.015676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:44.015537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" event={"ID":"2324128f-28ce-4991-aaa2-03ce64f72e72","Type":"ContainerStarted","Data":"78f25cb8791edaf107700cdbedc9a22ae0f677c6d2505217a9a4fe96e490a145"}
Jul 28 17:43:44.015676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:44.015588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:44.036990 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:44.036932    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podStartSLOduration=2.036916076 podStartE2EDuration="2.036916076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:43:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:43:44.033164369 +0000 UTC m=+2089.707117316" watchObservedRunningTime="2026-07-28 17:43:44.036916076 +0000 UTC m=+2089.710869022"
Jul 28 17:43:45.022165 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.022136    2579 generic.go:356] "Generic (PLEG): container finished" podID="a3f004e1-2f43-487a-9288-3d83749b7295" containerID="39a66fac8cd9d39cf2783a329c434d242d69dbc2643e4cdb4cbca8b6d6eb9593" exitCode=0
Jul 28 17:43:45.022537 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.022208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" event={"ID":"a3f004e1-2f43-487a-9288-3d83749b7295","Type":"ContainerDied","Data":"39a66fac8cd9d39cf2783a329c434d242d69dbc2643e4cdb4cbca8b6d6eb9593"}
Jul 28 17:43:45.022607 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.022536    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:45.023739 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.023717    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 28 17:43:45.103029 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.103005    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:43:45.188810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.188754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls\") pod \"a3f004e1-2f43-487a-9288-3d83749b7295\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") "
Jul 28 17:43:45.188810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.188786    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxjkt\" (UniqueName: \"kubernetes.io/projected/a3f004e1-2f43-487a-9288-3d83749b7295-kube-api-access-jxjkt\") pod \"a3f004e1-2f43-487a-9288-3d83749b7295\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") "
Jul 28 17:43:45.188810 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.188806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a3f004e1-2f43-487a-9288-3d83749b7295-kube-rbac-proxy-sar-config\") pod \"a3f004e1-2f43-487a-9288-3d83749b7295\" (UID: \"a3f004e1-2f43-487a-9288-3d83749b7295\") "
Jul 28 17:43:45.189202 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.189181    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3f004e1-2f43-487a-9288-3d83749b7295-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a3f004e1-2f43-487a-9288-3d83749b7295" (UID: "a3f004e1-2f43-487a-9288-3d83749b7295"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:43:45.190805 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.190776    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a3f004e1-2f43-487a-9288-3d83749b7295" (UID: "a3f004e1-2f43-487a-9288-3d83749b7295"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:43:45.190963 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.190945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f004e1-2f43-487a-9288-3d83749b7295-kube-api-access-jxjkt" (OuterVolumeSpecName: "kube-api-access-jxjkt") pod "a3f004e1-2f43-487a-9288-3d83749b7295" (UID: "a3f004e1-2f43-487a-9288-3d83749b7295"). InnerVolumeSpecName "kube-api-access-jxjkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:43:45.289504 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.289477    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3f004e1-2f43-487a-9288-3d83749b7295-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:43:45.289504 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.289500    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxjkt\" (UniqueName: \"kubernetes.io/projected/a3f004e1-2f43-487a-9288-3d83749b7295-kube-api-access-jxjkt\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:43:45.289651 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:45.289510    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a3f004e1-2f43-487a-9288-3d83749b7295-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:43:46.028189 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.028162    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"
Jul 28 17:43:46.028676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.028193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8" event={"ID":"a3f004e1-2f43-487a-9288-3d83749b7295","Type":"ContainerDied","Data":"4e719b2b0631abea4e90370ecd67f3424ce46511f7b00050291a9f7d3ad2f8b5"}
Jul 28 17:43:46.028676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.028251    2579 scope.go:117] "RemoveContainer" containerID="84aec5730ecede2255e59916930b0a4c130d5f0a5528000c8eb8ea1876bb72f6"
Jul 28 17:43:46.028676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.028577    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 28 17:43:46.037314 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.037296    2579 scope.go:117] "RemoveContainer" containerID="39a66fac8cd9d39cf2783a329c434d242d69dbc2643e4cdb4cbca8b6d6eb9593"
Jul 28 17:43:46.052727 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.052706    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"]
Jul 28 17:43:46.054837 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.054820    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a513a-predictor-d745bdcc6-9xwj8"]
Jul 28 17:43:46.932441 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:46.932413    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" path="/var/lib/kubelet/pods/a3f004e1-2f43-487a-9288-3d83749b7295/volumes"
Jul 28 17:43:51.033142 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:51.033112    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:43:51.033724 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:51.033580    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 28 17:43:54.928452 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:54.928419    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:43:54.928927 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:54.928611    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:43:56.568547 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.568511    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"]
Jul 28 17:43:56.568935 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.568726    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container" containerID="cri-o://21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4" gracePeriod=30
Jul 28 17:43:56.568935 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.568809    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kube-rbac-proxy" containerID="cri-o://ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32" gracePeriod=30
Jul 28 17:43:56.680502 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680472    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"]
Jul 28 17:43:56.680827 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680814    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kube-rbac-proxy"
Jul 28 17:43:56.680894 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680828    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kube-rbac-proxy"
Jul 28 17:43:56.680894 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680849    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container"
Jul 28 17:43:56.680894 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680855    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container"
Jul 28 17:43:56.681038 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680904    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kube-rbac-proxy"
Jul 28 17:43:56.681038 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.680916    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f004e1-2f43-487a-9288-3d83749b7295" containerName="kserve-container"
Jul 28 17:43:56.686084 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.686059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.688821 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.688798    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-824fb-predictor-serving-cert\""
Jul 28 17:43:56.688946 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.688798    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-824fb-kube-rbac-proxy-sar-config\""
Jul 28 17:43:56.696608 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.696580    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"]
Jul 28 17:43:56.772720 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.772680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbhxn\" (UniqueName: \"kubernetes.io/projected/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-api-access-dbhxn\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.772888 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.772801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.772888 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.772851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.873764 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.873731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbhxn\" (UniqueName: \"kubernetes.io/projected/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-api-access-dbhxn\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.873900 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.873780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.873900 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.873817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.874024 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:43:56.873978    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-824fb-predictor-serving-cert: secret "error-404-isvc-824fb-predictor-serving-cert" not found
Jul 28 17:43:56.874079 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:43:56.874049    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls podName:2e45aaf6-2b1c-48fb-8e95-178b3f25a924 nodeName:}" failed. No retries permitted until 2026-07-28 17:43:57.374027861 +0000 UTC m=+2103.047980797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls") pod "error-404-isvc-824fb-predictor-8dbccd486-x4jf6" (UID: "2e45aaf6-2b1c-48fb-8e95-178b3f25a924") : secret "error-404-isvc-824fb-predictor-serving-cert" not found
Jul 28 17:43:56.874477 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.874458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:56.883062 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:56.883031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbhxn\" (UniqueName: \"kubernetes.io/projected/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-api-access-dbhxn\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:57.078363 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:57.078329    2579 generic.go:356] "Generic (PLEG): container finished" podID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerID="ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32" exitCode=2
Jul 28 17:43:57.078529 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:57.078402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" event={"ID":"470a255e-f2cb-4500-8b66-5d4e26766e9e","Type":"ContainerDied","Data":"ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32"}
Jul 28 17:43:57.378209 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:57.378183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:57.380641 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:57.380610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls\") pod \"error-404-isvc-824fb-predictor-8dbccd486-x4jf6\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") " pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:57.598918 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:57.598876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:57.744664 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:57.744627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"]
Jul 28 17:43:57.751088 ip-10-0-131-184 kubenswrapper[2579]: W0728 17:43:57.751038    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e45aaf6_2b1c_48fb_8e95_178b3f25a924.slice/crio-41900262c1a52c7c25517729b33749e04a367b42a9f70c0ec77944e825f9ba76 WatchSource:0}: Error finding container 41900262c1a52c7c25517729b33749e04a367b42a9f70c0ec77944e825f9ba76: Status 404 returned error can't find the container with id 41900262c1a52c7c25517729b33749e04a367b42a9f70c0ec77944e825f9ba76
Jul 28 17:43:58.084988 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:58.084901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" event={"ID":"2e45aaf6-2b1c-48fb-8e95-178b3f25a924","Type":"ContainerStarted","Data":"e17da438cc67c9d1e22a8d732b3ef5d7dc95d966c16f2ea5d02b9c1342b545b1"}
Jul 28 17:43:58.084988 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:58.084968    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:58.085161 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:58.084990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" event={"ID":"2e45aaf6-2b1c-48fb-8e95-178b3f25a924","Type":"ContainerStarted","Data":"240db97daf20c4fc31fbeed14ec62bd602ac5d5a2b921ab441f6c30152b34186"}
Jul 28 17:43:58.085161 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:58.085008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" event={"ID":"2e45aaf6-2b1c-48fb-8e95-178b3f25a924","Type":"ContainerStarted","Data":"41900262c1a52c7c25517729b33749e04a367b42a9f70c0ec77944e825f9ba76"}
Jul 28 17:43:58.106881 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:58.106836    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podStartSLOduration=2.106822797 podStartE2EDuration="2.106822797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:43:58.105325986 +0000 UTC m=+2103.779278932" watchObservedRunningTime="2026-07-28 17:43:58.106822797 +0000 UTC m=+2103.780775741"
Jul 28 17:43:59.089255 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.089221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:43:59.090507 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.090478    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 28 17:43:59.812326 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.812299    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:43:59.906299 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.906255    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls\") pod \"470a255e-f2cb-4500-8b66-5d4e26766e9e\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") "
Jul 28 17:43:59.906432 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.906316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-rbac-proxy-sar-config\") pod \"470a255e-f2cb-4500-8b66-5d4e26766e9e\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") "
Jul 28 17:43:59.906432 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.906374    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nqnt\" (UniqueName: \"kubernetes.io/projected/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-api-access-6nqnt\") pod \"470a255e-f2cb-4500-8b66-5d4e26766e9e\" (UID: \"470a255e-f2cb-4500-8b66-5d4e26766e9e\") "
Jul 28 17:43:59.906668 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.906636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "470a255e-f2cb-4500-8b66-5d4e26766e9e" (UID: "470a255e-f2cb-4500-8b66-5d4e26766e9e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:43:59.908241 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.908220    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "470a255e-f2cb-4500-8b66-5d4e26766e9e" (UID: "470a255e-f2cb-4500-8b66-5d4e26766e9e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:43:59.908468 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:43:59.908450    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-api-access-6nqnt" (OuterVolumeSpecName: "kube-api-access-6nqnt") pod "470a255e-f2cb-4500-8b66-5d4e26766e9e" (UID: "470a255e-f2cb-4500-8b66-5d4e26766e9e"). InnerVolumeSpecName "kube-api-access-6nqnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:44:00.007009 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.006937    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/470a255e-f2cb-4500-8b66-5d4e26766e9e-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:44:00.007009 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.006960    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:44:00.007176 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.007046    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nqnt\" (UniqueName: \"kubernetes.io/projected/470a255e-f2cb-4500-8b66-5d4e26766e9e-kube-api-access-6nqnt\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:44:00.094840 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.094807    2579 generic.go:356] "Generic (PLEG): container finished" podID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerID="21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4" exitCode=0
Jul 28 17:44:00.095313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.094868    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"
Jul 28 17:44:00.095313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.094896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" event={"ID":"470a255e-f2cb-4500-8b66-5d4e26766e9e","Type":"ContainerDied","Data":"21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4"}
Jul 28 17:44:00.095313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.094957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" event={"ID":"470a255e-f2cb-4500-8b66-5d4e26766e9e","Type":"ContainerDied","Data":"849fdb9a49f5be7d51808fb1ed9730a0db66631e6a6800e060079476f370692d"}
Jul 28 17:44:00.095313 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.094984    2579 scope.go:117] "RemoveContainer" containerID="ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32"
Jul 28 17:44:00.095551 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.095426    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 28 17:44:00.103640 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.103621    2579 scope.go:117] "RemoveContainer" containerID="21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4"
Jul 28 17:44:00.111425 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.111407    2579 scope.go:117] "RemoveContainer" containerID="ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32"
Jul 28 17:44:00.111670 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:44:00.111653    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32\": container with ID starting with ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32 not found: ID does not exist" containerID="ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32"
Jul 28 17:44:00.111742 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.111683    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32"} err="failed to get container status \"ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32\": rpc error: code = NotFound desc = could not find container \"ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32\": container with ID starting with ac6e9f309636700128d5ea7282c6a9bcc80a69969d2200f68d2c4c3a258a1e32 not found: ID does not exist"
Jul 28 17:44:00.111742 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.111706    2579 scope.go:117] "RemoveContainer" containerID="21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4"
Jul 28 17:44:00.111948 ip-10-0-131-184 kubenswrapper[2579]: E0728 17:44:00.111931    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4\": container with ID starting with 21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4 not found: ID does not exist" containerID="21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4"
Jul 28 17:44:00.111986 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.111954    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4"} err="failed to get container status \"21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4\": rpc error: code = NotFound desc = could not find container \"21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4\": container with ID starting with 21aa16bf12159a92ecc5fa9146b94f37c7a0d91984098245652881d00e0965a4 not found: ID does not exist"
Jul 28 17:44:00.122292 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.120581    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"]
Jul 28 17:44:00.123990 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.123709    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv"]
Jul 28 17:44:00.777805 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.777761    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-11994-predictor-5d8c7b5cfd-kxqxv" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 28 17:44:00.932351 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:00.932320    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" path="/var/lib/kubelet/pods/470a255e-f2cb-4500-8b66-5d4e26766e9e/volumes"
Jul 28 17:44:01.034230 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:01.034152    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 28 17:44:05.100180 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:05.100148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:44:05.100759 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:05.100731    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 28 17:44:11.033895 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:11.033856    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 28 17:44:15.100916 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:15.100876    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 28 17:44:21.034467 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:21.034417    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 28 17:44:25.101095 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:25.101052    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 28 17:44:31.034413 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:31.034382    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 17:44:35.101395 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:35.101353    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 28 17:44:45.102119 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:44:45.102089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:48:54.956788 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:48:54.956757    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:48:54.960002 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:48:54.959979    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:53:11.371343 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:11.371302    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"]
Jul 28 17:53:11.373672 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:11.371626    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container" containerID="cri-o://240db97daf20c4fc31fbeed14ec62bd602ac5d5a2b921ab441f6c30152b34186" gracePeriod=30
Jul 28 17:53:11.373672 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:11.371739    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kube-rbac-proxy" containerID="cri-o://e17da438cc67c9d1e22a8d732b3ef5d7dc95d966c16f2ea5d02b9c1342b545b1" gracePeriod=30
Jul 28 17:53:11.576023 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:11.575982    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerID="e17da438cc67c9d1e22a8d732b3ef5d7dc95d966c16f2ea5d02b9c1342b545b1" exitCode=2
Jul 28 17:53:11.576178 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:11.576053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" event={"ID":"2e45aaf6-2b1c-48fb-8e95-178b3f25a924","Type":"ContainerDied","Data":"e17da438cc67c9d1e22a8d732b3ef5d7dc95d966c16f2ea5d02b9c1342b545b1"}
Jul 28 17:53:14.592430 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.592399    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerID="240db97daf20c4fc31fbeed14ec62bd602ac5d5a2b921ab441f6c30152b34186" exitCode=0
Jul 28 17:53:14.592790 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.592477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" event={"ID":"2e45aaf6-2b1c-48fb-8e95-178b3f25a924","Type":"ContainerDied","Data":"240db97daf20c4fc31fbeed14ec62bd602ac5d5a2b921ab441f6c30152b34186"}
Jul 28 17:53:14.620548 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.620520    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:53:14.708546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.708444    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-rbac-proxy-sar-config\") pod \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") "
Jul 28 17:53:14.708546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.708489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbhxn\" (UniqueName: \"kubernetes.io/projected/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-api-access-dbhxn\") pod \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") "
Jul 28 17:53:14.708546 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.708527    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls\") pod \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\" (UID: \"2e45aaf6-2b1c-48fb-8e95-178b3f25a924\") "
Jul 28 17:53:14.708825 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.708803    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2e45aaf6-2b1c-48fb-8e95-178b3f25a924" (UID: "2e45aaf6-2b1c-48fb-8e95-178b3f25a924"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:53:14.710615 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.710587    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2e45aaf6-2b1c-48fb-8e95-178b3f25a924" (UID: "2e45aaf6-2b1c-48fb-8e95-178b3f25a924"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:53:14.710734 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.710653    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-api-access-dbhxn" (OuterVolumeSpecName: "kube-api-access-dbhxn") pod "2e45aaf6-2b1c-48fb-8e95-178b3f25a924" (UID: "2e45aaf6-2b1c-48fb-8e95-178b3f25a924"). InnerVolumeSpecName "kube-api-access-dbhxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:53:14.809120 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.809068    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:53:14.809120 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.809113    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbhxn\" (UniqueName: \"kubernetes.io/projected/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-kube-api-access-dbhxn\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:53:14.809120 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:14.809123    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2e45aaf6-2b1c-48fb-8e95-178b3f25a924-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 17:53:15.599049 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:15.599015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6" event={"ID":"2e45aaf6-2b1c-48fb-8e95-178b3f25a924","Type":"ContainerDied","Data":"41900262c1a52c7c25517729b33749e04a367b42a9f70c0ec77944e825f9ba76"}
Jul 28 17:53:15.599523 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:15.599056    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"
Jul 28 17:53:15.599523 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:15.599086    2579 scope.go:117] "RemoveContainer" containerID="e17da438cc67c9d1e22a8d732b3ef5d7dc95d966c16f2ea5d02b9c1342b545b1"
Jul 28 17:53:15.607676 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:15.607657    2579 scope.go:117] "RemoveContainer" containerID="240db97daf20c4fc31fbeed14ec62bd602ac5d5a2b921ab441f6c30152b34186"
Jul 28 17:53:15.618170 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:15.618144    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"]
Jul 28 17:53:15.620300 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:15.620254    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-824fb-predictor-8dbccd486-x4jf6"]
Jul 28 17:53:16.932885 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:16.932847    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" path="/var/lib/kubelet/pods/2e45aaf6-2b1c-48fb-8e95-178b3f25a924/volumes"
Jul 28 17:53:54.983334 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:54.983240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:53:54.988353 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:53:54.988331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:58:55.009349 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:58:55.009238    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 17:58:55.016879 ip-10-0-131-184 kubenswrapper[2579]: I0728 17:58:55.016856    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 18:01:01.808383 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:01.808343    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"]
Jul 28 18:01:01.808934 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:01.808670    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container" containerID="cri-o://cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8" gracePeriod=30
Jul 28 18:01:01.808934 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:01.808709    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kube-rbac-proxy" containerID="cri-o://941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41" gracePeriod=30
Jul 28 18:01:02.660016 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:02.659982    2579 generic.go:356] "Generic (PLEG): container finished" podID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerID="941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41" exitCode=2
Jul 28 18:01:02.660187 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:02.660028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" event={"ID":"2324128f-28ce-4991-aaa2-03ce64f72e72","Type":"ContainerDied","Data":"941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41"}
Jul 28 18:01:05.065532 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.065507    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 18:01:05.110863 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.110836    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-rbac-proxy-sar-config\") pod \"2324128f-28ce-4991-aaa2-03ce64f72e72\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") "
Jul 28 18:01:05.111005 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.110889    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls\") pod \"2324128f-28ce-4991-aaa2-03ce64f72e72\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") "
Jul 28 18:01:05.111005 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.110930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9kp9\" (UniqueName: \"kubernetes.io/projected/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-api-access-p9kp9\") pod \"2324128f-28ce-4991-aaa2-03ce64f72e72\" (UID: \"2324128f-28ce-4991-aaa2-03ce64f72e72\") "
Jul 28 18:01:05.111224 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.111183    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2324128f-28ce-4991-aaa2-03ce64f72e72" (UID: "2324128f-28ce-4991-aaa2-03ce64f72e72"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 18:01:05.113078 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.113056    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-api-access-p9kp9" (OuterVolumeSpecName: "kube-api-access-p9kp9") pod "2324128f-28ce-4991-aaa2-03ce64f72e72" (UID: "2324128f-28ce-4991-aaa2-03ce64f72e72"). InnerVolumeSpecName "kube-api-access-p9kp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:01:05.113158 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.113074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2324128f-28ce-4991-aaa2-03ce64f72e72" (UID: "2324128f-28ce-4991-aaa2-03ce64f72e72"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:01:05.212438 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.212390    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9kp9\" (UniqueName: \"kubernetes.io/projected/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-api-access-p9kp9\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 18:01:05.212438 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.212430    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2324128f-28ce-4991-aaa2-03ce64f72e72-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 18:01:05.212438 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.212441    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2324128f-28ce-4991-aaa2-03ce64f72e72-proxy-tls\") on node \"ip-10-0-131-184.ec2.internal\" DevicePath \"\""
Jul 28 18:01:05.674316 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.674283    2579 generic.go:356] "Generic (PLEG): container finished" podID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerID="cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8" exitCode=0
Jul 28 18:01:05.674496 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.674354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" event={"ID":"2324128f-28ce-4991-aaa2-03ce64f72e72","Type":"ContainerDied","Data":"cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8"}
Jul 28 18:01:05.674496 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.674361    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"
Jul 28 18:01:05.674496 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.674402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq" event={"ID":"2324128f-28ce-4991-aaa2-03ce64f72e72","Type":"ContainerDied","Data":"78f25cb8791edaf107700cdbedc9a22ae0f677c6d2505217a9a4fe96e490a145"}
Jul 28 18:01:05.674496 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.674428    2579 scope.go:117] "RemoveContainer" containerID="941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41"
Jul 28 18:01:05.683521 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.683501    2579 scope.go:117] "RemoveContainer" containerID="cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8"
Jul 28 18:01:05.691043 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.691023    2579 scope.go:117] "RemoveContainer" containerID="941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41"
Jul 28 18:01:05.691326 ip-10-0-131-184 kubenswrapper[2579]: E0728 18:01:05.691296    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41\": container with ID starting with 941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41 not found: ID does not exist" containerID="941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41"
Jul 28 18:01:05.691424 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.691336    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41"} err="failed to get container status \"941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41\": rpc error: code = NotFound desc = could not find container \"941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41\": container with ID starting with 941bfb976def65c977760e5a6a023d2d9f8f9903543effccacd314e8f505cf41 not found: ID does not exist"
Jul 28 18:01:05.691424 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.691355    2579 scope.go:117] "RemoveContainer" containerID="cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8"
Jul 28 18:01:05.691590 ip-10-0-131-184 kubenswrapper[2579]: E0728 18:01:05.691571    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8\": container with ID starting with cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8 not found: ID does not exist" containerID="cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8"
Jul 28 18:01:05.691649 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.691600    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8"} err="failed to get container status \"cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8\": rpc error: code = NotFound desc = could not find container \"cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8\": container with ID starting with cfd97d492c04ee87a5348ee6e0258add19d617c5190f42b96ba2acfa58515ed8 not found: ID does not exist"
Jul 28 18:01:05.699494 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.699471    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"]
Jul 28 18:01:05.703738 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:05.703717    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0dc16-predictor-6b9b847f98-nskqq"]
Jul 28 18:01:06.931777 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:06.931744    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" path="/var/lib/kubelet/pods/2324128f-28ce-4991-aaa2-03ce64f72e72/volumes"
Jul 28 18:01:31.435650 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.435553    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nsx4t/must-gather-s9xqj"]
Jul 28 18:01:31.436538 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436514    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kube-rbac-proxy"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436542    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kube-rbac-proxy"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436571    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kube-rbac-proxy"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436580    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kube-rbac-proxy"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436596    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436606    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436627    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container"
Jul 28 18:01:31.436646 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436635    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436650    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436659    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436674    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kube-rbac-proxy"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436681    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kube-rbac-proxy"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436812    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kube-rbac-proxy"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436828    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e45aaf6-2b1c-48fb-8e95-178b3f25a924" containerName="kserve-container"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436839    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kube-rbac-proxy"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436853    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kserve-container"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436862    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="470a255e-f2cb-4500-8b66-5d4e26766e9e" containerName="kserve-container"
Jul 28 18:01:31.437318 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.436872    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2324128f-28ce-4991-aaa2-03ce64f72e72" containerName="kube-rbac-proxy"
Jul 28 18:01:31.441351 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.441327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.444590 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.444550    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nsx4t\"/\"kube-root-ca.crt\""
Jul 28 18:01:31.444788 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.444770    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nsx4t\"/\"openshift-service-ca.crt\""
Jul 28 18:01:31.445703 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.445683    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nsx4t\"/\"default-dockercfg-qqmtf\""
Jul 28 18:01:31.446360 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.446337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nsx4t/must-gather-s9xqj"]
Jul 28 18:01:31.532872 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.532836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/665231b7-b59c-42ac-8af4-8f7d1ea081c9-must-gather-output\") pod \"must-gather-s9xqj\" (UID: \"665231b7-b59c-42ac-8af4-8f7d1ea081c9\") " pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.533090 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.532892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jmmp\" (UniqueName: \"kubernetes.io/projected/665231b7-b59c-42ac-8af4-8f7d1ea081c9-kube-api-access-7jmmp\") pod \"must-gather-s9xqj\" (UID: \"665231b7-b59c-42ac-8af4-8f7d1ea081c9\") " pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.633431 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.633397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/665231b7-b59c-42ac-8af4-8f7d1ea081c9-must-gather-output\") pod \"must-gather-s9xqj\" (UID: \"665231b7-b59c-42ac-8af4-8f7d1ea081c9\") " pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.633620 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.633480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jmmp\" (UniqueName: \"kubernetes.io/projected/665231b7-b59c-42ac-8af4-8f7d1ea081c9-kube-api-access-7jmmp\") pod \"must-gather-s9xqj\" (UID: \"665231b7-b59c-42ac-8af4-8f7d1ea081c9\") " pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.633744 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.633724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/665231b7-b59c-42ac-8af4-8f7d1ea081c9-must-gather-output\") pod \"must-gather-s9xqj\" (UID: \"665231b7-b59c-42ac-8af4-8f7d1ea081c9\") " pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.642473 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.642448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jmmp\" (UniqueName: \"kubernetes.io/projected/665231b7-b59c-42ac-8af4-8f7d1ea081c9-kube-api-access-7jmmp\") pod \"must-gather-s9xqj\" (UID: \"665231b7-b59c-42ac-8af4-8f7d1ea081c9\") " pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.751589 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.751489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nsx4t/must-gather-s9xqj"
Jul 28 18:01:31.887002 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.886966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nsx4t/must-gather-s9xqj"]
Jul 28 18:01:31.889896 ip-10-0-131-184 kubenswrapper[2579]: W0728 18:01:31.889866    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665231b7_b59c_42ac_8af4_8f7d1ea081c9.slice/crio-dbc6b950da76f988477927bac51c19bb7554cf675da4e082d42bdcf8f9f03d47 WatchSource:0}: Error finding container dbc6b950da76f988477927bac51c19bb7554cf675da4e082d42bdcf8f9f03d47: Status 404 returned error can't find the container with id dbc6b950da76f988477927bac51c19bb7554cf675da4e082d42bdcf8f9f03d47
Jul 28 18:01:31.891711 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:31.891690    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 18:01:32.793030 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:32.792992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nsx4t/must-gather-s9xqj" event={"ID":"665231b7-b59c-42ac-8af4-8f7d1ea081c9","Type":"ContainerStarted","Data":"dbc6b950da76f988477927bac51c19bb7554cf675da4e082d42bdcf8f9f03d47"}
Jul 28 18:01:34.808042 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:34.807707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nsx4t/must-gather-s9xqj" event={"ID":"665231b7-b59c-42ac-8af4-8f7d1ea081c9","Type":"ContainerStarted","Data":"ee2a8fa9f876d6a8da815e10954e429f62650168b6e8a2057e843911be586d3b"}
Jul 28 18:01:34.808042 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:34.807764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nsx4t/must-gather-s9xqj" event={"ID":"665231b7-b59c-42ac-8af4-8f7d1ea081c9","Type":"ContainerStarted","Data":"8ca1094abfb36d11859788608dd8915e8e876830f83465f6d36cea834660458b"}
Jul 28 18:01:34.826687 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:34.826628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nsx4t/must-gather-s9xqj" podStartSLOduration=1.854341984 podStartE2EDuration="3.826604809s" totalImagesPullingTime="1.972262825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:34.826004733 +0000 UTC m=+3160.499957679" watchObservedRunningTime="2026-07-28 18:01:34.826604809 +0000 UTC m=+3160.500557755"
Jul 28 18:01:35.207589 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:35.207556    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-45ltp_9a36411a-3b90-45bd-8db0-d13e602573b4/global-pull-secret-syncer/0.log"
Jul 28 18:01:35.378903 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:35.378875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gm67k_36b38e59-1188-4c97-91ff-431a055d1f06/konnectivity-agent/0.log"
Jul 28 18:01:35.459910 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:35.459839    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-184.ec2.internal_0feefa2c5e96de0b03b7f75cc7fb5cbc/haproxy/0.log"
Jul 28 18:01:40.236569 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.236540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/alertmanager/0.log"
Jul 28 18:01:40.265605 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.265527    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/config-reloader/0.log"
Jul 28 18:01:40.293760 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.293729    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/kube-rbac-proxy-web/0.log"
Jul 28 18:01:40.318670 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.318630    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/kube-rbac-proxy/0.log"
Jul 28 18:01:40.354757 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.354730    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/kube-rbac-proxy-metric/0.log"
Jul 28 18:01:40.381361 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.381330    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/prom-label-proxy/0.log"
Jul 28 18:01:40.405747 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.405689    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5742f24-eb96-4040-844c-11747bcede1d/init-config-reloader/0.log"
Jul 28 18:01:40.835825 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.835768    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzpnf_f2f4f300-bc6f-469f-8b58-59e0c05e87ee/node-exporter/0.log"
Jul 28 18:01:40.859141 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.859044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzpnf_f2f4f300-bc6f-469f-8b58-59e0c05e87ee/kube-rbac-proxy/0.log"
Jul 28 18:01:40.883465 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:40.883430    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzpnf_f2f4f300-bc6f-469f-8b58-59e0c05e87ee/init-textfile/0.log"
Jul 28 18:01:41.282475 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.282439    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-d52nt_ea2a9a70-f33b-44d4-82db-6c2b4eedc40b/prometheus-operator-admission-webhook/0.log"
Jul 28 18:01:41.398199 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.398163    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/thanos-query/0.log"
Jul 28 18:01:41.421289 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.421248    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy-web/0.log"
Jul 28 18:01:41.443023 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.442992    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy/0.log"
Jul 28 18:01:41.466251 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.466223    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/prom-label-proxy/0.log"
Jul 28 18:01:41.487435 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.487408    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy-rules/0.log"
Jul 28 18:01:41.522300 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:41.520418    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6845768684-qwkxl_8a871994-11ff-42da-bfa0-e7bbdbd89d95/kube-rbac-proxy-metrics/0.log"
Jul 28 18:01:43.432202 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:43.432171    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/2.log"
Jul 28 18:01:43.437571 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:43.437545    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l88sm_e808385e-50e9-44fc-8d50-a57dbca2dcd4/console-operator/3.log"
Jul 28 18:01:43.878159 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:43.878127    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-h75c9_ebf6b172-1e75-4ea5-ab07-1fad5d50bc21/download-server/0.log"
Jul 28 18:01:43.990156 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:43.990110    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"]
Jul 28 18:01:43.994410 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:43.994376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.001092 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.001064    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"]
Jul 28 18:01:44.038512 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.038476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-sys\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.038730 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.038525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-proc\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.038730 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.038585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-podres\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.038730 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.038696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-lib-modules\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.038859 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.038739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsdv\" (UniqueName: \"kubernetes.io/projected/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-kube-api-access-klsdv\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140180 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsdv\" (UniqueName: \"kubernetes.io/projected/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-kube-api-access-klsdv\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140180 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-sys\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140180 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-proc\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140493 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-podres\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140493 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-lib-modules\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140493 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-lib-modules\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140660 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-proc\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140660 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-podres\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.140660 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.140608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-sys\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.149662 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.149637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsdv\" (UniqueName: \"kubernetes.io/projected/d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8-kube-api-access-klsdv\") pod \"perf-node-gather-daemonset-hm2zj\" (UID: \"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8\") " pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.307827 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.307795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.472664 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.472229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"]
Jul 28 18:01:44.883377 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.883332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj" event={"ID":"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8","Type":"ContainerStarted","Data":"2f2a57fcd7d6abf9246f8cd5de8426aecbfba96a77013286802a05ae0fd7366f"}
Jul 28 18:01:44.883578 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.883402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj" event={"ID":"d55e23f4-a6d6-40a7-93ed-25b6ab1c01c8","Type":"ContainerStarted","Data":"228da3541ea136d3f0b68794739af76dc2f17efb931c179d81164df4e818e87e"}
Jul 28 18:01:44.884178 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.884148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:44.906188 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:44.906126    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj" podStartSLOduration=1.906104827 podStartE2EDuration="1.906104827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:44.902570314 +0000 UTC m=+3170.576523259" watchObservedRunningTime="2026-07-28 18:01:44.906104827 +0000 UTC m=+3170.580057773"
Jul 28 18:01:45.460315 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:45.460285    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wbvtz_3e9b89fb-70f1-4b81-8d31-53971f2e18a0/dns/0.log"
Jul 28 18:01:45.493621 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:45.493596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wbvtz_3e9b89fb-70f1-4b81-8d31-53971f2e18a0/kube-rbac-proxy/0.log"
Jul 28 18:01:45.595937 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:45.595902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sg74h_80a6a903-ef6e-4fa0-98e6-bcc0d4d31380/dns-node-resolver/0.log"
Jul 28 18:01:46.169691 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:46.169656    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnblw_b4b56a44-32e8-42a4-a100-7b99e718331c/node-ca/0.log"
Jul 28 18:01:47.378596 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:47.378564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6h6x_4eddd939-47d2-458e-a0c1-0c4ade7a74fc/serve-healthcheck-canary/0.log"
Jul 28 18:01:47.796900 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:47.796822    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5pxbc_0d90c577-1ad2-4844-ac06-f97ca197b9b4/kube-rbac-proxy/0.log"
Jul 28 18:01:47.822427 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:47.822400    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5pxbc_0d90c577-1ad2-4844-ac06-f97ca197b9b4/exporter/0.log"
Jul 28 18:01:47.847206 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:47.847181    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5pxbc_0d90c577-1ad2-4844-ac06-f97ca197b9b4/extractor/0.log"
Jul 28 18:01:50.270613 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:50.270582    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-bspjc_a25f64e1-1cfb-4a03-a6c5-2c67e27aac7e/manager/0.log"
Jul 28 18:01:50.297798 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:50.297769    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-xp77r_811a6eef-802f-4165-8616-bc5475492b77/server/0.log"
Jul 28 18:01:51.907916 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:51.907879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nsx4t/perf-node-gather-daemonset-hm2zj"
Jul 28 18:01:54.809923 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:54.809890    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8c9nl_87bbf73b-0e1f-4545-a24e-4b15f531d999/migrator/0.log"
Jul 28 18:01:54.835085 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:54.835057    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8c9nl_87bbf73b-0e1f-4545-a24e-4b15f531d999/graceful-termination/0.log"
Jul 28 18:01:56.499123 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.499089    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/kube-multus-additional-cni-plugins/0.log"
Jul 28 18:01:56.518432 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.518405    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/egress-router-binary-copy/0.log"
Jul 28 18:01:56.540387 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.540361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/cni-plugins/0.log"
Jul 28 18:01:56.562549 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.562514    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/bond-cni-plugin/0.log"
Jul 28 18:01:56.585215 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.585188    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/routeoverride-cni/0.log"
Jul 28 18:01:56.606063 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.606032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/whereabouts-cni-bincopy/0.log"
Jul 28 18:01:56.630965 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.630943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6stf_15e5d427-15a3-4402-b2c5-7c9679b95ed0/whereabouts-cni/0.log"
Jul 28 18:01:56.670865 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.670835    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kh4q2_e498b396-fc1e-44bc-bc18-8744c278927d/kube-multus/0.log"
Jul 28 18:01:56.764757 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.764685    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8tv92_985e10c3-b813-4d6c-a47e-889875e4eec2/network-metrics-daemon/0.log"
Jul 28 18:01:56.785802 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:56.785779    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8tv92_985e10c3-b813-4d6c-a47e-889875e4eec2/kube-rbac-proxy/0.log"
Jul 28 18:01:57.934986 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:57.934948    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/ovn-controller/0.log"
Jul 28 18:01:57.961531 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:57.961498    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/ovn-acl-logging/0.log"
Jul 28 18:01:57.989675 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:57.989651    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/kube-rbac-proxy-node/0.log"
Jul 28 18:01:58.011152 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:58.011123    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 18:01:58.032500 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:58.032477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/northd/0.log"
Jul 28 18:01:58.072866 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:58.072840    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/nbdb/0.log"
Jul 28 18:01:58.096754 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:58.096730    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/sbdb/0.log"
Jul 28 18:01:58.153160 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:58.153126    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nwb2w_a749cd5b-06f5-4cc4-b30e-c30b7049c99f/ovnkube-controller/0.log"
Jul 28 18:01:59.397992 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:01:59.397957    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mxtvs_5e4c0c21-57cc-47ff-9d08-0b6bd6da2f47/network-check-target-container/0.log"
Jul 28 18:02:00.380110 ip-10-0-131-184 kubenswrapper[2579]: I0728 18:02:00.380082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-44pfn_9885c4ad-8159-4736-a8ce-f87dead967eb/iptables-alerter/0.log"