Aug 04 12:27:21.191006 ip-10-0-132-243 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 12:27:21.644516 ip-10-0-132-243 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 12:27:21.644516 ip-10-0-132-243 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 12:27:21.644516 ip-10-0-132-243 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 12:27:21.644516 ip-10-0-132-243 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 12:27:21.644516 ip-10-0-132-243 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 12:27:21.645253 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.644598    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 12:27:21.649577 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649561    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 12:27:21.649577 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649577    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649581    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649585    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649588    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649591    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649594    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649619    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649622    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649625    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649628    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649630    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649633    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649635    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649638    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649641    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649643    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649646    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649648    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649652    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 12:27:21.649647 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649655    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649657    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649660    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649662    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649665    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649667    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649670    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649672    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649675    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649677    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649680    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649683    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649685    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649688    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649690    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649693    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649696    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649698    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649700    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649703    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 12:27:21.650122 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649706    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649708    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649710    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649713    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649715    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649719    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649723    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649726    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649744    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649747    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649749    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649751    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649754    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649756    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649760    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649764    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649766    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649769    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649772    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649774    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 12:27:21.650626 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649777    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649779    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649782    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649784    2574 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649786    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649789    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649791    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649794    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649796    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649799    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649801    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649804    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649808    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649811    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649813    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649817    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649821    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649823    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649827    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 12:27:21.651156 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649830    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649832    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649835    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649837    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649839    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649842    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649844    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649847    2574 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649850    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649853    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649856    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649858    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649861    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649863    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649866    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649868    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649871    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649875    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649878    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.649881    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 12:27:21.651625 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650594    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650602    2574 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650605    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650608    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650611    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650614    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650617    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650620    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650623    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650626    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650629    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650631    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650634    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650636    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650639    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650641    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650644    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650647    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650649    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650653    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 12:27:21.652129 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650655    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650658    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650661    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650665    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650668    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650671    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650674    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650677    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650680    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650683    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650685    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650688    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650691    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650693    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650696    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650698    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650700    2574 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650703    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650706    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 12:27:21.652760 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650710    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650713    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650716    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650719    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650722    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650724    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650744    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650748    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650751    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650754    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650756    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650759    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650763    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650767    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650770    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650773    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650776    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650779    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650781    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 12:27:21.653271 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650784    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650786    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650789    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650791    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650794    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650797    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650799    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650802    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650804    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650807    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650809    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650813    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650815    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650818    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650821    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650824    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650826    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650829    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650832    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650835    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 12:27:21.653759 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650838    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650840    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650843    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650845    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650847    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650851    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650853    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650856    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650859    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650861    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650864    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650866    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650868    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650871    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650874    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650876    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650878    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650880    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650883    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650885    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 12:27:21.654252 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.650887    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651273    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651279    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651282    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651285    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651289    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651293    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651295    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651298    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651300    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651303    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651306    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651308    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651311    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651315    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651319    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651322    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651328    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651331    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 12:27:21.654753 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651334    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651337    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651340    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651345    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651349    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651352    2574 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651355    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651357    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651360    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651362    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651365    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651367    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651370    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651372    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651375    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651401    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651427    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651433    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651436    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651440    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 12:27:21.655213 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651444    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651447    2574 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651451    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651454    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651456    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651459    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651461    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651464    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651468    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651470    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651473    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651476    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651479    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651481    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651484    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651486    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651489    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651491    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651494    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651497    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 12:27:21.655700 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651499    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651502    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651504    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651507    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651509    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651512    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651514    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651516    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651520    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651524    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651526    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651529    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651535    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651539    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651542    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651545    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651548    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651550    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651553    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 12:27:21.656201 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651556    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651559    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651562    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651565    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651567    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651570    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651572    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651575    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651578    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651580    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651583    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651585    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651588    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651591    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651593    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651596    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651598    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651601    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651603    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651606    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 12:27:21.656650 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651608    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.651611    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651705    2574 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651719    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651727    2574 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651748    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651752    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651756    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651771    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651776    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651779    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651782    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651786    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651789    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651792    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651796    2574 flags.go:64] FLAG: --cgroup-root=""
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651799    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651802    2574 flags.go:64] FLAG: --client-ca-file=""
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651805    2574 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651808    2574 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651812    2574 flags.go:64] FLAG: --cluster-domain=""
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651815    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651818    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651821    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 12:27:21.657141 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651824    2574 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651828    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651831    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651834    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651837    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651840    2574 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651843    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651846    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651849    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651852    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651858    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651861    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651864    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651867    2574 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651870    2574 flags.go:64] FLAG: --enable-server="true"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651873    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651878    2574 flags.go:64] FLAG: --event-burst="100"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651881    2574 flags.go:64] FLAG: --event-qps="50"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651884    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651887    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651890    2574 flags.go:64] FLAG: --eviction-hard=""
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651893    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651896    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651899    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651902    2574 flags.go:64] FLAG: --eviction-soft=""
Aug 04 12:27:21.657726 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651905    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651908    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651911    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651913    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651916    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651919    2574 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651922    2574 flags.go:64] FLAG: --feature-gates=""
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651925    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651928    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651931    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651934    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651937    2574 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651940    2574 flags.go:64] FLAG: --help="false"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651943    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651946    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651948    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651954    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651958    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651963    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651966    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651969    2574 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651972    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651975    2574 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 12:27:21.658354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651977    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651981    2574 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651984    2574 flags.go:64] FLAG: --kube-reserved=""
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651987    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651990    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651993    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651996    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.651998    2574 flags.go:64] FLAG: --lock-file=""
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652001    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652004    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652007    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652012    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652015    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652018    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652021    2574 flags.go:64] FLAG: --logging-format="text"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652024    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652027    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652030    2574 flags.go:64] FLAG: --manifest-url=""
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652032    2574 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652037    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652040    2574 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652045    2574 flags.go:64] FLAG: --max-pods="110"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652047    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652050    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652053    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 12:27:21.659041 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652058    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652061    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652064    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652067    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652076    2574 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652080    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652083    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652086    2574 flags.go:64] FLAG: --pod-cidr=""
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652089    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652095    2574 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652098    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652101    2574 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652104    2574 flags.go:64] FLAG: --port="10250"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652107    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652110    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b5cf53f36cf06c7"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652113    2574 flags.go:64] FLAG: --qos-reserved=""
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652116    2574 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652119    2574 flags.go:64] FLAG: --register-node="true"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652122    2574 flags.go:64] FLAG: --register-with-taints=""
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652126    2574 flags.go:64] FLAG: --registry-burst="10"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652128    2574 flags.go:64] FLAG: --registry-qps="5"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652131    2574 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652134    2574 flags.go:64] FLAG: --reserved-memory=""
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652138    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652141    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 12:27:21.659647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652144    2574 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652146    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652149    2574 flags.go:64] FLAG: --runonce="false"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652152    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652155    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652158    2574 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652161    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652163    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652168    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652171    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652174    2574 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652177    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652179    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652183    2574 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652186    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652189    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652191    2574 flags.go:64] FLAG: --system-cgroups=""
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652194    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652200    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652203    2574 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652205    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652209    2574 flags.go:64] FLAG: --tls-min-version=""
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652212    2574 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652215    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652218    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 12:27:21.660286 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652221    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652225    2574 flags.go:64] FLAG: --v="2"
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652229    2574 flags.go:64] FLAG: --version="false"
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652233    2574 flags.go:64] FLAG: --vmodule=""
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652236    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652240    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652413    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652418    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652421    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652424    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652427    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652430    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652433    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652435    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652438    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652442    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652445    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652448    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652450    2574 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652453    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652455    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 12:27:21.661025 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652458    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652463    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652466    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652469    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652471    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652474    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652476    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652479    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652481    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652484    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652486    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652489    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652492    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652494    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652497    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652500    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652502    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652505    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652507    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 12:27:21.661840 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652510    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652512    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652515    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652517    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652520    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652522    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652525    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652531    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652535    2574 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652538    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652541    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652544    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652547    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652550    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652553    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652556    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652558    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652561    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652564    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652566    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 12:27:21.662324 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652569    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652571    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652574    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652576    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652579    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652581    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652584    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652586    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652589    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652591    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652594    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652596    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652599    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652601    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652603    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652607    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652610    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652613    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652616    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652622    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 12:27:21.662906 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652625    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652628    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652630    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652633    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652636    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652638    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652641    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652644    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652647    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652651    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652653    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652656    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652658    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652661    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652663    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652666    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652669    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652671    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652673    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 12:27:21.663395 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652676    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652678    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652681    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652683    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652685    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.652688    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.652693    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.660166    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.660183    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.660201    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.660207    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660261    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660266    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660269    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660272    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 12:27:21.663870 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660276    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660278    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660282    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660285    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660287    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660291    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660293    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660297    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660300    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660303    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660306    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660309    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660312    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660315    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660317    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660320    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660322    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660325    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660328    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660330    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 12:27:21.664241 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660333    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660335    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660338    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660342    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660346    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660350    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660353    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660356    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660359    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660361    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660364    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660366    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660368    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660371    2574 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660374    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660376    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660379    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660381    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660384    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660386    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 12:27:21.664722 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660389    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660391    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660394    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660396    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660399    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660401    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660403    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660406    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660408    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660411    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660413    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660416    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660420    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660423    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660426    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660430    2574 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660433    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660436    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660439    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 12:27:21.665229 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660441    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660445    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660449    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660452    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660455    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660459    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660462    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660464    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660467    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660470    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660472    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660475    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660477    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660480    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660482    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660485    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660487    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660490    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660492    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660495    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 12:27:21.665696 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660497    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660500    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660502    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660505    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660507    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660510    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660512    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660515    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660518    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660520    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660523    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660525    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660529    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660531    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660534    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 12:27:21.666235 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.660536    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.660541    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662091    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662105    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662109    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662112    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662115    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662118    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662124    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662128    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662131    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662134    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662137    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662140    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 12:27:21.666601 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662143    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662146    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662149    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662152    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662155    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662157    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662159    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662163    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662165    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662168    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662171    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662174    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662177    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662180    2574 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662182    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662185    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662188    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662190    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662193    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662196    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 12:27:21.667117 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662199    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662201    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662204    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662206    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662209    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662212    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662214    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662217    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662219    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662221    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662224    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662227    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662229    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662232    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662234    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662237    2574 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662239    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662243    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662246    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662249    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 12:27:21.667594 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662252    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662255    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662257    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662260    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662263    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662265    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662269    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662272    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662275    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662278    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662280    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662283    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662286    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662288    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662291    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662293    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662297    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662299    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662302    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 12:27:21.668081 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662304    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662307    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662309    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662311    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662314    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662316    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662318    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662321    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662323    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662326    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662328    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662331    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662335    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662338    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662341    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662343    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662345    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662348    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662351    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 12:27:21.668545 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662354    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662356    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662359    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662362    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662364    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662366    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662369    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662371    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:21.662374    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.662379    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.662507    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.665847    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.667592    2574 server.go:1019] "Starting client certificate rotation"
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.667698    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 12:27:21.669018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.667748    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 12:27:21.670447 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.670432    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 12:27:21.674564 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.674547    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 12:27:21.687709 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.687692    2574 log.go:25] "Validated CRI v1 runtime API"
Aug 04 12:27:21.690204 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.690187    2574 log.go:25] "Validated CRI v1 image API"
Aug 04 12:27:21.691068 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.691048    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 12:27:21.694450 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.694421    2574 fs.go:135] Filesystem UUIDs: map[06043b72-0fd5-4729-9a71-67dbf85c3041:/dev/nvme0n1p4 0f945048-f028-48f4-bb74-8b31da105860:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Aug 04 12:27:21.694536 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.694449    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 12:27:21.699711 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.699607    2574 manager.go:216] Machine: {Timestamp:2026-08-04 12:27:21.698255089 +0000 UTC m=+0.375786561 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3077514 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c6d3d43c552a31d699507779c0820 SystemUUID:ec2c6d3d-43c5-52a3-1d69-9507779c0820 BootID:ca31eaf1-ef99-4e64-b7df-4044857821b4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:72:83:47:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:72:83:47:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:d1:a0:b1:dd:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 12:27:21.699711 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.699711    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 12:27:21.699828 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.699808    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 12:27:21.699828 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.699815    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 12:27:21.703294 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.703264    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 12:27:21.703439 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.703297    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 12:27:21.704153 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.704143    2574 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 12:27:21.704191 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.704156    2574 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 12:27:21.704191 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.704163    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 12:27:21.705016 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.705006    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 12:27:21.706363 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.706352    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 12:27:21.711675 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711663    2574 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 12:27:21.711870 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711859    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 12:27:21.711906 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711901    2574 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 12:27:21.711945 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711922    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 12:27:21.711945 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711935    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 12:27:21.711945 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711945    2574 kubelet.go:398] "Adding apiserver pod source"
Aug 04 12:27:21.712066 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.711954    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 12:27:21.712370 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.712358    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 12:27:21.712405 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.712376    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 12:27:21.716057 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.716028    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 12:27:21.718432 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.718416    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 12:27:21.718531 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.718454    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 12:27:21.719885 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719868    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719891    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719902    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719911    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719924    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719932    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719945    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719954    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 12:27:21.719966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719964    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 12:27:21.720200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719972    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 12:27:21.720200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719984    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 12:27:21.720200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.719993    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 12:27:21.720774 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.720762    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 12:27:21.720812 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.720775    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 12:27:21.722803 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.722779    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 12:27:21.723044 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.723026    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 12:27:21.723106 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.723091    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 12:27:21.723279 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.723265    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-24v74"
Aug 04 12:27:21.724057 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.724046    2574 server.go:1268] "Started kubelet"
Aug 04 12:27:21.724139 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.724110    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 12:27:21.724323 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.724139    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 12:27:21.724390 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.724374    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 12:27:21.724952 ip-10-0-132-243 systemd[1]: Started Kubernetes Kubelet.
Aug 04 12:27:21.726539 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.726527    2574 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 12:27:21.728170 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.728153    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 12:27:21.729758 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.729743    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-24v74"
Aug 04 12:27:21.731632 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.731612    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 12:27:21.736030 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736014    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 12:27:21.736119 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736031    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 12:27:21.736119 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.736087    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:21.736818 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736792    2574 factory.go:55] Registering systemd factory
Aug 04 12:27:21.736818 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736813    2574 factory.go:223] Registration of the systemd container factory successfully
Aug 04 12:27:21.736959 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736911    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 12:27:21.736959 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736935    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 12:27:21.736959 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.736946    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 12:27:21.737078 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737053    2574 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 12:27:21.737078 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737063    2574 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 12:27:21.737156 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737082    2574 factory.go:153] Registering CRI-O factory
Aug 04 12:27:21.737156 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737093    2574 factory.go:223] Registration of the crio container factory successfully
Aug 04 12:27:21.737156 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737144    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 12:27:21.737276 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737175    2574 factory.go:103] Registering Raw factory
Aug 04 12:27:21.737276 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737193    2574 manager.go:1196] Started watching for new ooms in manager
Aug 04 12:27:21.737679 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.737666    2574 manager.go:349] Starting recovery of all containers
Aug 04 12:27:21.738297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.738276    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 12:27:21.742153 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.742131    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-243.ec2.internal\" not found" node="ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.749278 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.749261    2574 manager.go:354] Recovery completed
Aug 04 12:27:21.754671 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.754653    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.756377 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.756356    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.756458 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.756393    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.756458 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.756405    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.757032 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757019    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 12:27:21.757098 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757034    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 12:27:21.757098 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757054    2574 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 12:27:21.757098 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757025    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.757794 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757779    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.757848 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757801    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.757848 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.757814    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.759171 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.759159    2574 policy_none.go:49] "None policy: Start"
Aug 04 12:27:21.759211 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.759175    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 12:27:21.759211 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.759185    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 12:27:21.761064 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.761054    2574 policy_none.go:47] "Start"
Aug 04 12:27:21.810710 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.810683    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.811980    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.812017    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.812034    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.812066    2574 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.814078    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815322    2574 manager.go:337] "Starting Device Plugin manager"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.815349    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815358    2574 server.go:87] "Starting device plugin registration server"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815621    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815635    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815724    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815834    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.815846    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.816332    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 12:27:21.821407 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.816372    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:21.913080 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.912964    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"]
Aug 04 12:27:21.913080 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.913078    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.914871 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.914854    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.914983 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.914887    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.914983 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.914902    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.915948 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.915931    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.916643 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.916627    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.916707 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.916654    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.916707 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.916663    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.916707 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.916679    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.917321 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.917175    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.917389 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.917302    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.917453 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.917424    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.918029 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.918014    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.918101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.918016    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.918101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.918066    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.918101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.918084    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.918101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.918045    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.918245 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.918115    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.920227 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.920211    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.920310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.920235    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 12:27:21.920884 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.920868    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 12:27:21.920956 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.920903    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 12:27:21.920956 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.920919    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeHasSufficientPID"
Aug 04 12:27:21.923403 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.923389    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.923446 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.923409    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-243.ec2.internal\": node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:21.933535 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.933520    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:21.936288 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.936274    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-243.ec2.internal\" not found" node="ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.938311 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.938293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67bc6bf42c3318f73612f2d04ecf4093-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"67bc6bf42c3318f73612f2d04ecf4093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.938366 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.938325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67bc6bf42c3318f73612f2d04ecf4093-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"67bc6bf42c3318f73612f2d04ecf4093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.938405 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:21.938368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e5018d200709bf17205fbeb9a1858db-config\") pod \"kube-apiserver-proxy-ip-10-0-132-243.ec2.internal\" (UID: \"0e5018d200709bf17205fbeb9a1858db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:21.940914 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:21.940901    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-243.ec2.internal\" not found" node="ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.033891 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.033867    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.039193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.039176    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67bc6bf42c3318f73612f2d04ecf4093-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"67bc6bf42c3318f73612f2d04ecf4093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.039256 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.039202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67bc6bf42c3318f73612f2d04ecf4093-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"67bc6bf42c3318f73612f2d04ecf4093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.039256 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.039221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e5018d200709bf17205fbeb9a1858db-config\") pod \"kube-apiserver-proxy-ip-10-0-132-243.ec2.internal\" (UID: \"0e5018d200709bf17205fbeb9a1858db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.039256 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.039247    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e5018d200709bf17205fbeb9a1858db-config\") pod \"kube-apiserver-proxy-ip-10-0-132-243.ec2.internal\" (UID: \"0e5018d200709bf17205fbeb9a1858db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.039356 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.039271    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67bc6bf42c3318f73612f2d04ecf4093-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"67bc6bf42c3318f73612f2d04ecf4093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.039356 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.039281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67bc6bf42c3318f73612f2d04ecf4093-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal\" (UID: \"67bc6bf42c3318f73612f2d04ecf4093\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.134319 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.134287    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.235140 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.235080    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.240408 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.240391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.244537 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.244522    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:22.335286 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.335250    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.435769 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.435746    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.536293 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.536215    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.636697 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.636661    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.667077 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.667052    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 12:27:22.667505 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.667212    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 12:27:22.667505 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.667226    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 12:27:22.734354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.734318    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 12:22:22 +0000 UTC" deadline="2028-02-14 01:58:06.6189831 +0000 UTC"
Aug 04 12:27:22.734354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.734349    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13405h30m43.884638178s"
Aug 04 12:27:22.736963 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.736945    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.837823 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.837768    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:22.890820 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:22.890781    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5018d200709bf17205fbeb9a1858db.slice/crio-25cf88b1a84756bb2a12c88f0e6fd225905f4bbfb588610d6852037cc74dbbf9 WatchSource:0}: Error finding container 25cf88b1a84756bb2a12c88f0e6fd225905f4bbfb588610d6852037cc74dbbf9: Status 404 returned error can't find the container with id 25cf88b1a84756bb2a12c88f0e6fd225905f4bbfb588610d6852037cc74dbbf9
Aug 04 12:27:22.891174 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:22.891155    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bc6bf42c3318f73612f2d04ecf4093.slice/crio-31a1c4ad10b5cda27663cd9363de6ff1fb31da1194659ce28795bd80954c7532 WatchSource:0}: Error finding container 31a1c4ad10b5cda27663cd9363de6ff1fb31da1194659ce28795bd80954c7532: Status 404 returned error can't find the container with id 31a1c4ad10b5cda27663cd9363de6ff1fb31da1194659ce28795bd80954c7532
Aug 04 12:27:22.897433 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.897420    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 12:27:22.937895 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:22.937868    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 12:27:22.938050 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:22.937877    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:24.192437 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:24.192408    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:24.292990 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:24.292903    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-243.ec2.internal\" not found"
Aug 04 12:27:24.351518 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.351490    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 12:27:24.389854 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.389821    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:24.403031 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.403007    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 12:27:24.404075 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.404063    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal"
Aug 04 12:27:24.414921 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.414900    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 12:27:24.632294 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.632220    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 12:27:24.867092 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.867059    2574 apiserver.go:52] "Watching apiserver"
Aug 04 12:27:24.891114 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.891037    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 12:27:24.894101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.894075    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 12:27:24.894539 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.894501    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pzpbt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal","openshift-multus/network-metrics-daemon-drrfq","openshift-network-operator/iptables-alerter-nr4p4","openshift-ovn-kubernetes/ovnkube-node-88ncj","kube-system/global-pull-secret-syncer-5sct2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w","openshift-dns/node-resolver-87dc2","openshift-image-registry/node-ca-sggfd","openshift-multus/multus-8mwcw","openshift-multus/multus-additional-cni-plugins-x5tzv","openshift-network-diagnostics/network-check-target-cx2hk","kube-system/konnectivity-agent-ktqrt"]
Aug 04 12:27:24.896939 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.896921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:24.897061 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:24.896989    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:24.899012 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.898988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:24.899099 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:24.899052    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:24.901174 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.901155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:24.903966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.903949    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 12:27:24.904168 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.903971    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n9t8g\""
Aug 04 12:27:24.904242 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.903999    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:24.904299 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.904045    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 12:27:24.904299 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:24.904253    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:24.905027 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.905005    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 12:27:24.906941 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.906926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:24.911210 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.909523    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:24.911210 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.909626    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.911210 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.909721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 12:27:24.911210 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.910009    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fvwcn\""
Aug 04 12:27:24.911210 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.910272    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.912078 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.912061    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 12:27:24.912469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.912455    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:24.913860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.913622    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bgvl4\""
Aug 04 12:27:24.913860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.913637    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 12:27:24.913860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.913668    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.913860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.913716    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 12:27:24.913860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.913643    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 12:27:24.913860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.913622    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.915960 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.915604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:24.917453 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.917434    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.917545 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.917488    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q7ddl\""
Aug 04 12:27:24.918442 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.918050    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:24.918442 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.918088    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 12:27:24.918585 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.918465    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.918638 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.918629    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l6stk\""
Aug 04 12:27:24.918690 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.918662    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.918884 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.918870    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.920497 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.920465    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:24.921221 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.921204    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.921320 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.921230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.921320 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.921271    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bzl6k\""
Aug 04 12:27:24.922920 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.922903    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.923067 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.923047    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 12:27:24.923182 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.923166    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6czjj\""
Aug 04 12:27:24.923244 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.923219    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.923529 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.923513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:24.926001 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.925986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:24.927491 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.927471    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-88sf5\""
Aug 04 12:27:24.927583 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.927498    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 12:27:24.927583 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.927538    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 12:27:24.927583 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.927479    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 12:27:24.927736 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.927681    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 12:27:24.930147 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.930115    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 12:27:24.930147 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.930143    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s5g82\""
Aug 04 12:27:24.930288 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.930190    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 12:27:24.930541 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.930525    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7dj4"
Aug 04 12:27:24.936705 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.936686    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7dj4"
Aug 04 12:27:24.971272 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.971229    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" event={"ID":"67bc6bf42c3318f73612f2d04ecf4093","Type":"ContainerStarted","Data":"31a1c4ad10b5cda27663cd9363de6ff1fb31da1194659ce28795bd80954c7532"}
Aug 04 12:27:24.972571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.972548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" event={"ID":"0e5018d200709bf17205fbeb9a1858db","Type":"ContainerStarted","Data":"25cf88b1a84756bb2a12c88f0e6fd225905f4bbfb588610d6852037cc74dbbf9"}
Aug 04 12:27:24.991845 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:24.991827    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 12:27:25.002115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6281c301-ef47-422b-98a5-290e9a7cffd0-tmp-dir\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.002223 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c92c6f0-85a8-4660-92c7-5e9227510d32-serviceca\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.002223 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-netns\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002223 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-sys\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.002223 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.002223 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002219    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccm6f\" (UniqueName: \"kubernetes.io/projected/7c92c6f0-85a8-4660-92c7-5e9227510d32-kube-api-access-ccm6f\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-cni-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6xk\" (UniqueName: \"kubernetes.io/projected/fa507e95-6d53-4523-8af5-1bd766f7c5cf-kube-api-access-wp6xk\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-ovn\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-modprobe-d\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.002469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm58p\" (UniqueName: \"kubernetes.io/projected/6281c301-ef47-422b-98a5-290e9a7cffd0-kube-api-access-dm58p\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-cnibin\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002563    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-socket-dir-parent\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-cni-bin\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002648    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-daemon-config\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-etc-kubernetes\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-systemd-units\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002708    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-device-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-run-netns\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.002742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39dccca5-3465-4b16-b9ed-81ab84241f24-ovn-node-metrics-cert\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysconfig\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-kubernetes\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysctl-d\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-cnibin\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7h6w\" (UniqueName: \"kubernetes.io/projected/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-kube-api-access-j7h6w\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-etc-selinux\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-run\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.002988    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-var-lib-kubelet\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003037    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6281c301-ef47-422b-98a5-290e9a7cffd0-hosts-file\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.003130 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-kubelet\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21f4896a-2f32-432f-8beb-29c8c18c8f47-konnectivity-ca\") pod \"konnectivity-agent-ktqrt\" (UID: \"21f4896a-2f32-432f-8beb-29c8c18c8f47\") " pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-systemd\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003221    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-host\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-system-cni-dir\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-os-release\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003307    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-multus-certs\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-systemd\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/231d0bfa-19d3-4367-b16a-c936128db344-etc-tuned\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-os-release\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjrnq\" (UniqueName: \"kubernetes.io/projected/74cc9684-d953-4ee6-8e00-be68daddd2eb-kube-api-access-xjrnq\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003456    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eecfeab-29a6-4d03-bf06-009184b3d5c8-iptables-alerter-script\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-kubelet\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.003571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-run-ovn-kubernetes\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkm7p\" (UniqueName: \"kubernetes.io/projected/9eecfeab-29a6-4d03-bf06-009184b3d5c8-kube-api-access-kkm7p\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c92c6f0-85a8-4660-92c7-5e9227510d32-host\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003619    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6d05309-a5b9-4a01-878e-e4000488b9c5-dbus\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-cni-multus\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003652    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-conf-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003721    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-ovnkube-config\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003752    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-socket-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysctl-conf\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-system-cni-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21f4896a-2f32-432f-8beb-29c8c18c8f47-agent-certs\") pod \"konnectivity-agent-ktqrt\" (UID: \"21f4896a-2f32-432f-8beb-29c8c18c8f47\") " pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-etc-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-node-log\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zg4\" (UniqueName: \"kubernetes.io/projected/39dccca5-3465-4b16-b9ed-81ab84241f24-kube-api-access-l9zg4\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.004129 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-lib-modules\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa507e95-6d53-4523-8af5-1bd766f7c5cf-cni-binary-copy\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.003993    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-hostroot\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-log-socket\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-cni-netd\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-ovnkube-script-lib\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-sys-fs\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4p8q\" (UniqueName: \"kubernetes.io/projected/51034303-db90-467c-a29b-58437e4a09de-kube-api-access-j4p8q\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpwd\" (UniqueName: \"kubernetes.io/projected/231d0bfa-19d3-4367-b16a-c936128db344-kube-api-access-8fpwd\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-var-lib-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-cni-bin\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-env-overrides\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-k8s-cni-cncf-io\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-registration-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004273    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/231d0bfa-19d3-4367-b16a-c936128db344-tmp\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.004704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6d05309-a5b9-4a01-878e-e4000488b9c5-kubelet-config\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.005200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eecfeab-29a6-4d03-bf06-009184b3d5c8-host-slash\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.005200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.004336    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-slash\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.104561 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-system-cni-dir\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-os-release\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-system-cni-dir\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-multus-certs\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-systemd\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104676    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/231d0bfa-19d3-4367-b16a-c936128db344-etc-tuned\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-os-release\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-multus-certs\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104714    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-os-release\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.104735 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjrnq\" (UniqueName: \"kubernetes.io/projected/74cc9684-d953-4ee6-8e00-be68daddd2eb-kube-api-access-xjrnq\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eecfeab-29a6-4d03-bf06-009184b3d5c8-iptables-alerter-script\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-kubelet\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.104822    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-run-ovn-kubernetes\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkm7p\" (UniqueName: \"kubernetes.io/projected/9eecfeab-29a6-4d03-bf06-009184b3d5c8-kube-api-access-kkm7p\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.104936    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:25.604904902 +0000 UTC m=+3.128779625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c92c6f0-85a8-4660-92c7-5e9227510d32-host\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.104986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6d05309-a5b9-4a01-878e-e4000488b9c5-dbus\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105012    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-cni-multus\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-conf-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.105169 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105055    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-ovnkube-config\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-socket-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysctl-conf\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-system-cni-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21f4896a-2f32-432f-8beb-29c8c18c8f47-agent-certs\") pod \"konnectivity-agent-ktqrt\" (UID: \"21f4896a-2f32-432f-8beb-29c8c18c8f47\") " pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-etc-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-node-log\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zg4\" (UniqueName: \"kubernetes.io/projected/39dccca5-3465-4b16-b9ed-81ab84241f24-kube-api-access-l9zg4\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-lib-modules\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-ovnkube-config\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105634    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa507e95-6d53-4523-8af5-1bd766f7c5cf-cni-binary-copy\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-hostroot\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-os-release\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.105760 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-log-socket\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.106319 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.105777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-conf-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.106319 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.106319 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106292    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-systemd\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.106505 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106374    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-socket-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.106505 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106486    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysctl-conf\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.106600 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106532    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-system-cni-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.106691 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eecfeab-29a6-4d03-bf06-009184b3d5c8-iptables-alerter-script\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.106738 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-kubelet\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.106787 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106733    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-node-log\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.106787 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106781    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.106988 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.106956    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-etc-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107061 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107007    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-run-ovn-kubernetes\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107061 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-cni-netd\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107123 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-ovnkube-script-lib\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107123 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-sys-fs\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.107180 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4p8q\" (UniqueName: \"kubernetes.io/projected/51034303-db90-467c-a29b-58437e4a09de-kube-api-access-j4p8q\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.107221 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpwd\" (UniqueName: \"kubernetes.io/projected/231d0bfa-19d3-4367-b16a-c936128db344-kube-api-access-8fpwd\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.107255 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-var-lib-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107255 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107268    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-cni-bin\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa507e95-6d53-4523-8af5-1bd766f7c5cf-cni-binary-copy\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-env-overrides\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-k8s-cni-cncf-io\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-registration-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.107461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/231d0bfa-19d3-4367-b16a-c936128db344-tmp\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.107461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-lib-modules\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.107461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107406    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6d05309-a5b9-4a01-878e-e4000488b9c5-kubelet-config\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107478    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eecfeab-29a6-4d03-bf06-009184b3d5c8-host-slash\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-cni-bin\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-slash\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-cni-netd\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6281c301-ef47-422b-98a5-290e9a7cffd0-tmp-dir\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-hostroot\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c92c6f0-85a8-4660-92c7-5e9227510d32-serviceca\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-sys-fs\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.107601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107585    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-netns\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-sys\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-netns\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccm6f\" (UniqueName: \"kubernetes.io/projected/7c92c6f0-85a8-4660-92c7-5e9227510d32-kube-api-access-ccm6f\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-cni-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107697    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6xk\" (UniqueName: \"kubernetes.io/projected/fa507e95-6d53-4523-8af5-1bd766f7c5cf-kube-api-access-wp6xk\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-ovn\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107757    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-modprobe-d\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm58p\" (UniqueName: \"kubernetes.io/projected/6281c301-ef47-422b-98a5-290e9a7cffd0-kube-api-access-dm58p\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-cnibin\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-socket-dir-parent\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-cni-bin\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.107862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107862    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-daemon-config\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-etc-kubernetes\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107892    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-systemd-units\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-device-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-run-netns\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39dccca5-3465-4b16-b9ed-81ab84241f24-ovn-node-metrics-cert\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysconfig\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-kubernetes\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.107987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysctl-d\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-cnibin\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7h6w\" (UniqueName: \"kubernetes.io/projected/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-kube-api-access-j7h6w\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-etc-selinux\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-run\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-ovnkube-script-lib\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-var-lib-kubelet\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6281c301-ef47-422b-98a5-290e9a7cffd0-hosts-file\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.108267 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-etc-selinux\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-kubelet\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21f4896a-2f32-432f-8beb-29c8c18c8f47-konnectivity-ca\") pod \"konnectivity-agent-ktqrt\" (UID: \"21f4896a-2f32-432f-8beb-29c8c18c8f47\") " pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-systemd\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-host\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-host\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-run\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108379    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-run-ovn\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108465    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-run-k8s-cni-cncf-io\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-kubernetes\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.108542    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108562    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-registration-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.108588    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:25.608572635 +0000 UTC m=+3.132447341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysconfig\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-log-socket\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c92c6f0-85a8-4660-92c7-5e9227510d32-serviceca\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c92c6f0-85a8-4660-92c7-5e9227510d32-host\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6281c301-ef47-422b-98a5-290e9a7cffd0-hosts-file\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.108972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-sysctl-d\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108700    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-kubelet\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108730    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-cnibin\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-systemd\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108763    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-systemd-units\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-etc-modprobe-d\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6d05309-a5b9-4a01-878e-e4000488b9c5-dbus\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-cni-multus\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.108944    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-sys\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.109014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.109062    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74cc9684-d953-4ee6-8e00-be68daddd2eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.109888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.109324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21f4896a-2f32-432f-8beb-29c8c18c8f47-konnectivity-ca\") pod \"konnectivity-agent-ktqrt\" (UID: \"21f4896a-2f32-432f-8beb-29c8c18c8f47\") " pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.110511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110076    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6281c301-ef47-422b-98a5-290e9a7cffd0-tmp-dir\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.110511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-var-lib-openvswitch\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.110511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110199    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/231d0bfa-19d3-4367-b16a-c936128db344-etc-tuned\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.110511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/231d0bfa-19d3-4367-b16a-c936128db344-var-lib-kubelet\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.110511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21f4896a-2f32-432f-8beb-29c8c18c8f47-agent-certs\") pod \"konnectivity-agent-ktqrt\" (UID: \"21f4896a-2f32-432f-8beb-29c8c18c8f47\") " pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.110511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110365    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.110789 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110539    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-cni-dir\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.110789 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-run-netns\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.110789 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6d05309-a5b9-4a01-878e-e4000488b9c5-kubelet-config\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.110789 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-etc-kubernetes\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.110980 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110800    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74cc9684-d953-4ee6-8e00-be68daddd2eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.110980 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.110811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-cnibin\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.111109 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39dccca5-3465-4b16-b9ed-81ab84241f24-host-slash\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.111199 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111182    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/51034303-db90-467c-a29b-58437e4a09de-device-dir\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.111255 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39dccca5-3465-4b16-b9ed-81ab84241f24-env-overrides\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.111255 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eecfeab-29a6-4d03-bf06-009184b3d5c8-host-slash\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.111351 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/231d0bfa-19d3-4367-b16a-c936128db344-tmp\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.111351 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-socket-dir-parent\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.111466 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.111338    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa507e95-6d53-4523-8af5-1bd766f7c5cf-host-var-lib-cni-bin\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.112536 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.112513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa507e95-6d53-4523-8af5-1bd766f7c5cf-multus-daemon-config\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.113241 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.113222    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:25.113322 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.113245    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:25.113322 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.113266    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:25.113434 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.113331    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:25.613310209 +0000 UTC m=+3.137184928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:25.114339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.113719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39dccca5-3465-4b16-b9ed-81ab84241f24-ovn-node-metrics-cert\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.116113 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.116090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkm7p\" (UniqueName: \"kubernetes.io/projected/9eecfeab-29a6-4d03-bf06-009184b3d5c8-kube-api-access-kkm7p\") pod \"iptables-alerter-nr4p4\" (UID: \"9eecfeab-29a6-4d03-bf06-009184b3d5c8\") " pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.116251 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.116231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjrnq\" (UniqueName: \"kubernetes.io/projected/74cc9684-d953-4ee6-8e00-be68daddd2eb-kube-api-access-xjrnq\") pod \"multus-additional-cni-plugins-x5tzv\" (UID: \"74cc9684-d953-4ee6-8e00-be68daddd2eb\") " pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.116961 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.116940    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zg4\" (UniqueName: \"kubernetes.io/projected/39dccca5-3465-4b16-b9ed-81ab84241f24-kube-api-access-l9zg4\") pod \"ovnkube-node-88ncj\" (UID: \"39dccca5-3465-4b16-b9ed-81ab84241f24\") " pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.117751 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.117725    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4p8q\" (UniqueName: \"kubernetes.io/projected/51034303-db90-467c-a29b-58437e4a09de-kube-api-access-j4p8q\") pod \"aws-ebs-csi-driver-node-9qm5w\" (UID: \"51034303-db90-467c-a29b-58437e4a09de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.119613 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.119595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpwd\" (UniqueName: \"kubernetes.io/projected/231d0bfa-19d3-4367-b16a-c936128db344-kube-api-access-8fpwd\") pod \"tuned-pzpbt\" (UID: \"231d0bfa-19d3-4367-b16a-c936128db344\") " pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.122250 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.122229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6xk\" (UniqueName: \"kubernetes.io/projected/fa507e95-6d53-4523-8af5-1bd766f7c5cf-kube-api-access-wp6xk\") pod \"multus-8mwcw\" (UID: \"fa507e95-6d53-4523-8af5-1bd766f7c5cf\") " pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.123196 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.123173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccm6f\" (UniqueName: \"kubernetes.io/projected/7c92c6f0-85a8-4660-92c7-5e9227510d32-kube-api-access-ccm6f\") pod \"node-ca-sggfd\" (UID: \"7c92c6f0-85a8-4660-92c7-5e9227510d32\") " pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.123507 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.123489    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7h6w\" (UniqueName: \"kubernetes.io/projected/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-kube-api-access-j7h6w\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:25.123594 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.123574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm58p\" (UniqueName: \"kubernetes.io/projected/6281c301-ef47-422b-98a5-290e9a7cffd0-kube-api-access-dm58p\") pod \"node-resolver-87dc2\" (UID: \"6281c301-ef47-422b-98a5-290e9a7cffd0\") " pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.213734 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.213646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:25.224996 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.224972    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nr4p4"
Aug 04 12:27:25.237721 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.237686    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:25.242329 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.242304    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-87dc2"
Aug 04 12:27:25.249081 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.249054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w"
Aug 04 12:27:25.258816 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.258798    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pzpbt"
Aug 04 12:27:25.265566 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.265549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sggfd"
Aug 04 12:27:25.267566 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.267546    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 12:27:25.277078 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.277055    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8mwcw"
Aug 04 12:27:25.282927 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.282909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5tzv"
Aug 04 12:27:25.610773 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.610696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:25.610909 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.610781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:25.610909 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.610858    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:25.610909 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.610902    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:25.611036 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.610943    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:26.610915419 +0000 UTC m=+4.134790147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:25.611036 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.610961    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:26.610953341 +0000 UTC m=+4.134828049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:25.711244 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.711213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:25.711420 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.711353    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:25.711420 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.711379    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:25.711420 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.711406    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:25.711547 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:25.711461    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:26.711444568 +0000 UTC m=+4.235319280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:25.939697 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.939617    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 12:22:24 +0000 UTC" deadline="2028-04-06 21:16:56.886912832 +0000 UTC"
Aug 04 12:27:25.939697 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.939650    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14672h49m30.947268178s"
Aug 04 12:27:25.968641 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.968614    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6281c301_ef47_422b_98a5_290e9a7cffd0.slice/crio-ff9f37ddcedbd5f3ba100f7470e808328258fbe21f683775b84508c8c79e3ac7 WatchSource:0}: Error finding container ff9f37ddcedbd5f3ba100f7470e808328258fbe21f683775b84508c8c79e3ac7: Status 404 returned error can't find the container with id ff9f37ddcedbd5f3ba100f7470e808328258fbe21f683775b84508c8c79e3ac7
Aug 04 12:27:25.970237 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.970131    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74cc9684_d953_4ee6_8e00_be68daddd2eb.slice/crio-32b4e0e050a5e1a10955832cf76ddb83820fba4af0f04b8ad8f6f4a992430d32 WatchSource:0}: Error finding container 32b4e0e050a5e1a10955832cf76ddb83820fba4af0f04b8ad8f6f4a992430d32: Status 404 returned error can't find the container with id 32b4e0e050a5e1a10955832cf76ddb83820fba4af0f04b8ad8f6f4a992430d32
Aug 04 12:27:25.975411 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.975358    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eecfeab_29a6_4d03_bf06_009184b3d5c8.slice/crio-f7baf11a6fe337023ded0b0f1df5b8c292b3d1226a8be219960267f7ecfeb4e2 WatchSource:0}: Error finding container f7baf11a6fe337023ded0b0f1df5b8c292b3d1226a8be219960267f7ecfeb4e2: Status 404 returned error can't find the container with id f7baf11a6fe337023ded0b0f1df5b8c292b3d1226a8be219960267f7ecfeb4e2
Aug 04 12:27:25.975569 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.975535    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-87dc2" event={"ID":"6281c301-ef47-422b-98a5-290e9a7cffd0","Type":"ContainerStarted","Data":"ff9f37ddcedbd5f3ba100f7470e808328258fbe21f683775b84508c8c79e3ac7"}
Aug 04 12:27:25.976730 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.976652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pzpbt" event={"ID":"231d0bfa-19d3-4367-b16a-c936128db344","Type":"ContainerStarted","Data":"f3041a2ebbc2848a25f1e86ed4a8d26bb14315844456153ed0ee3f53a9b7129e"}
Aug 04 12:27:25.977144 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.977118    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa507e95_6d53_4523_8af5_1bd766f7c5cf.slice/crio-6096dce401550e2beee94f8b95b6bff3e48b2af08df66f7c69445952804373c7 WatchSource:0}: Error finding container 6096dce401550e2beee94f8b95b6bff3e48b2af08df66f7c69445952804373c7: Status 404 returned error can't find the container with id 6096dce401550e2beee94f8b95b6bff3e48b2af08df66f7c69445952804373c7
Aug 04 12:27:25.977360 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.977298    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c92c6f0_85a8_4660_92c7_5e9227510d32.slice/crio-111a3dbf949087c47724fc99cd95d7f6c3b804f4b8a129c6b2fb004dade2eaa7 WatchSource:0}: Error finding container 111a3dbf949087c47724fc99cd95d7f6c3b804f4b8a129c6b2fb004dade2eaa7: Status 404 returned error can't find the container with id 111a3dbf949087c47724fc99cd95d7f6c3b804f4b8a129c6b2fb004dade2eaa7
Aug 04 12:27:25.978143 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:25.978092    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerStarted","Data":"32b4e0e050a5e1a10955832cf76ddb83820fba4af0f04b8ad8f6f4a992430d32"}
Aug 04 12:27:25.979032 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.978892    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dccca5_3465_4b16_b9ed_81ab84241f24.slice/crio-2d16b8af9e8279b5b3c2600b766fab2b58011521105bdb0b7a1794b74fab8d5d WatchSource:0}: Error finding container 2d16b8af9e8279b5b3c2600b766fab2b58011521105bdb0b7a1794b74fab8d5d: Status 404 returned error can't find the container with id 2d16b8af9e8279b5b3c2600b766fab2b58011521105bdb0b7a1794b74fab8d5d
Aug 04 12:27:25.980512 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.980468    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51034303_db90_467c_a29b_58437e4a09de.slice/crio-4c991b4ece09e2ae1a360bbaba5ab20fd5dcce5dd80a7a6b223369d76bd08110 WatchSource:0}: Error finding container 4c991b4ece09e2ae1a360bbaba5ab20fd5dcce5dd80a7a6b223369d76bd08110: Status 404 returned error can't find the container with id 4c991b4ece09e2ae1a360bbaba5ab20fd5dcce5dd80a7a6b223369d76bd08110
Aug 04 12:27:25.981295 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:25.981275    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f4896a_2f32_432f_8beb_29c8c18c8f47.slice/crio-b93e7b28b0dfb9e0dddb9ae027266c69e0e1ee509edcfc7f50fb28d5d774dd5f WatchSource:0}: Error finding container b93e7b28b0dfb9e0dddb9ae027266c69e0e1ee509edcfc7f50fb28d5d774dd5f: Status 404 returned error can't find the container with id b93e7b28b0dfb9e0dddb9ae027266c69e0e1ee509edcfc7f50fb28d5d774dd5f
Aug 04 12:27:26.619111 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.618041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:26.619111 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.618337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:26.619111 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.618532    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:26.619111 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.618597    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:28.61857871 +0000 UTC m=+6.142453429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:26.619111 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.618982    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:26.619111 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.619031    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:28.61901593 +0000 UTC m=+6.142890638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:26.719840 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.719191    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:26.719840 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.719379    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:26.719840 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.719415    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:26.719840 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.719429    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:26.719840 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.719490    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:28.719470316 +0000 UTC m=+6.243345024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:26.940101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.940008    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 12:22:24 +0000 UTC" deadline="2028-05-18 05:52:58.775261576 +0000 UTC"
Aug 04 12:27:26.940101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.940051    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15665h25m31.835216153s"
Aug 04 12:27:26.968576 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.968550    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:26.968746 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.968592    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:26.968746 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.968691    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:26.968872 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.968782    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:26.968872 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.968862    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:26.969005 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:26.968981    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:26.991927 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:26.991896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nr4p4" event={"ID":"9eecfeab-29a6-4d03-bf06-009184b3d5c8","Type":"ContainerStarted","Data":"f7baf11a6fe337023ded0b0f1df5b8c292b3d1226a8be219960267f7ecfeb4e2"}
Aug 04 12:27:27.005199 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.005109    2574 generic.go:356] "Generic (PLEG): container finished" podID="67bc6bf42c3318f73612f2d04ecf4093" containerID="814ecc5b17a458e3ee475547ff426fc88562ab4af849f501cd2b26e462d06901" exitCode=0
Aug 04 12:27:27.005364 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.005195    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" event={"ID":"67bc6bf42c3318f73612f2d04ecf4093","Type":"ContainerDied","Data":"814ecc5b17a458e3ee475547ff426fc88562ab4af849f501cd2b26e462d06901"}
Aug 04 12:27:27.023313 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.023180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sggfd" event={"ID":"7c92c6f0-85a8-4660-92c7-5e9227510d32","Type":"ContainerStarted","Data":"111a3dbf949087c47724fc99cd95d7f6c3b804f4b8a129c6b2fb004dade2eaa7"}
Aug 04 12:27:27.036237 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.036203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8mwcw" event={"ID":"fa507e95-6d53-4523-8af5-1bd766f7c5cf","Type":"ContainerStarted","Data":"6096dce401550e2beee94f8b95b6bff3e48b2af08df66f7c69445952804373c7"}
Aug 04 12:27:27.057249 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.057211    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" event={"ID":"0e5018d200709bf17205fbeb9a1858db","Type":"ContainerStarted","Data":"242c38b44924e20387e6b6f47f0ddc1c74389c97b63d1f8f745cfe078201bedc"}
Aug 04 12:27:27.063333 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.063305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktqrt" event={"ID":"21f4896a-2f32-432f-8beb-29c8c18c8f47","Type":"ContainerStarted","Data":"b93e7b28b0dfb9e0dddb9ae027266c69e0e1ee509edcfc7f50fb28d5d774dd5f"}
Aug 04 12:27:27.076491 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.076465    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w" event={"ID":"51034303-db90-467c-a29b-58437e4a09de","Type":"ContainerStarted","Data":"4c991b4ece09e2ae1a360bbaba5ab20fd5dcce5dd80a7a6b223369d76bd08110"}
Aug 04 12:27:27.085471 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:27.085373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"2d16b8af9e8279b5b3c2600b766fab2b58011521105bdb0b7a1794b74fab8d5d"}
Aug 04 12:27:28.118720 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.118684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" event={"ID":"67bc6bf42c3318f73612f2d04ecf4093","Type":"ContainerStarted","Data":"3bd6688b1ad666404bd6f75cb1e16fc1460311ee827dee0dc990f155e6f55c42"}
Aug 04 12:27:28.137781 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.136672    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-243.ec2.internal" podStartSLOduration=4.136649631 podStartE2EDuration="4.136649631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:27.076623951 +0000 UTC m=+4.600498681" watchObservedRunningTime="2026-08-04 12:27:28.136649631 +0000 UTC m=+5.660524357"
Aug 04 12:27:28.637024 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.636983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:28.637226 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.637054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:28.637226 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.637194    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:28.637339 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.637256    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:32.637236821 +0000 UTC m=+10.161111535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:28.637692 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.637671    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:28.637795 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.637729    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:32.637713086 +0000 UTC m=+10.161587793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:28.738157 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.738117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:28.738318 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.738304    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:28.738376 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.738330    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:28.738376 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.738343    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:28.738517 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.738426    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:32.73838343 +0000 UTC m=+10.262258139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:28.966901 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.966819    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:28.967053 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.966985    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:28.967383 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.967360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:28.967504 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.967479    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:28.969792 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:28.969767    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:28.969901 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:28.969879    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:30.968037 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:30.967512    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:30.968037 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:30.967547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:30.968037 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:30.967518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:30.968037 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:30.967697    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:30.968037 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:30.967858    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:30.968037 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:30.967934    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:32.671647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:32.671607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:32.672115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:32.671656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:32.672115 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.671754    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:32.672115 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.671798    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:40.671785831 +0000 UTC m=+18.195660537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:32.672115 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.672112    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:32.672330 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.672146    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:40.672135484 +0000 UTC m=+18.196010189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:32.772926 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:32.772891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:32.773115 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.773093    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:32.773192 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.773122    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:32.773192 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.773136    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:32.773295 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.773201    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:40.773181693 +0000 UTC m=+18.297056405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:32.967944 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:32.967047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:32.967944 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.967184    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:32.967944 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:32.967624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:32.967944 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.967700    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:32.967944 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:32.967789    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:32.967944 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:32.967862    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:34.966643 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:34.966607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:34.967200 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:34.966726    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:34.967200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:34.966605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:34.967200 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:34.966797    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:34.967200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:34.966605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:34.967200 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:34.966862    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:36.966729 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:36.966696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:36.967187 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:36.966744    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:36.967187 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:36.966693    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:36.967187 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:36.966816    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:36.967187 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:36.966908    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:36.967187 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:36.967000    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:38.966319 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:38.966278    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:38.966784 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:38.966403    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:38.966784 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:38.966749    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:38.966901 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:38.966833    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:38.966968 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:38.966953    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:38.967040 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:38.967024    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:40.742224 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:40.742188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:40.742666 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:40.742252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:40.742666 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.742355    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:40.742666 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.742414    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:40.742666 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.742448    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:56.742430319 +0000 UTC m=+34.266305038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:40.742666 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.742472    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:56.742460142 +0000 UTC m=+34.266334850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:40.843096 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:40.843057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:40.843283 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.843174    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:40.843283 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.843192    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:40.843283 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.843201    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:40.843283 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.843253    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:56.843237391 +0000 UTC m=+34.367112096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:40.966016 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:40.965985    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:40.966177 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:40.965981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:40.966177 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.966112    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:40.966177 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:40.966129    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:40.966288 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.966188    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:40.966288 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:40.966257    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:42.967059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:42.967026    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:42.967524 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:42.967120    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:42.967524 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:42.967216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:42.967524 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:42.967319    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:42.967524 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:42.967369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:42.967524 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:42.967462    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:44.966589 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:44.966372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:44.967035 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:44.966672    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:44.967035 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:44.966553    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:44.967035 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:44.966740    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:44.967035 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:44.966435    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:44.967035 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:44.966805    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:45.152402 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.152340    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pzpbt" event={"ID":"231d0bfa-19d3-4367-b16a-c936128db344","Type":"ContainerStarted","Data":"ecd33f1073735a9104775c70da6e9d2185ff44d91a7f73ce5789ca868ebaad09"}
Aug 04 12:27:45.154172 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.154140    2574 generic.go:356] "Generic (PLEG): container finished" podID="74cc9684-d953-4ee6-8e00-be68daddd2eb" containerID="a31fa6f89162087515a380fcacaa060aa849b9525831d04e274714eac174885a" exitCode=0
Aug 04 12:27:45.154321 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.154222    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerDied","Data":"a31fa6f89162087515a380fcacaa060aa849b9525831d04e274714eac174885a"}
Aug 04 12:27:45.159684 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.156232    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-87dc2" event={"ID":"6281c301-ef47-422b-98a5-290e9a7cffd0","Type":"ContainerStarted","Data":"3eca3b39019d0cc015dd8ebcd4b70e8908d04e861f05be7f1141af17b4273676"}
Aug 04 12:27:45.159684 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.158557    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sggfd" event={"ID":"7c92c6f0-85a8-4660-92c7-5e9227510d32","Type":"ContainerStarted","Data":"47195fd98694a1f0aa5f8dff0c7e6238055279c524b3948021e30296835aad6b"}
Aug 04 12:27:45.161913 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.161559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8mwcw" event={"ID":"fa507e95-6d53-4523-8af5-1bd766f7c5cf","Type":"ContainerStarted","Data":"0bad09ba81ed484d8e082760f931c8f657bebbd821ebabacda01c3fca223c662"}
Aug 04 12:27:45.163099 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.163079    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktqrt" event={"ID":"21f4896a-2f32-432f-8beb-29c8c18c8f47","Type":"ContainerStarted","Data":"82fee55cfa4b5185e54cb83e45deb23512ae2ed746cdd07b21079d5909c53522"}
Aug 04 12:27:45.164645 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.164624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w" event={"ID":"51034303-db90-467c-a29b-58437e4a09de","Type":"ContainerStarted","Data":"5831558202de434a07a08ac3db36400fdf0a995298a1136892785b320f15237f"}
Aug 04 12:27:45.165991 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.165972    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:27:45.166422 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.166371    2574 generic.go:356] "Generic (PLEG): container finished" podID="39dccca5-3465-4b16-b9ed-81ab84241f24" containerID="10071c9189a2a096c53e5c9f6e02f6f86bd4bec9a770983d3dc0289d063a4425" exitCode=1
Aug 04 12:27:45.166500 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.166439    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerDied","Data":"10071c9189a2a096c53e5c9f6e02f6f86bd4bec9a770983d3dc0289d063a4425"}
Aug 04 12:27:45.166558 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.166517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"78a689bf5392f2468222700c1eaabbad0cfcba8a05b1322b79e346ba3f223e86"}
Aug 04 12:27:45.177661 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.177621    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pzpbt" podStartSLOduration=3.426976975 podStartE2EDuration="22.177608709s" totalImagesPullingTime="18.750631734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:45.177120852 +0000 UTC m=+22.700995578" watchObservedRunningTime="2026-08-04 12:27:45.177608709 +0000 UTC m=+22.701483435"
Aug 04 12:27:45.177752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.177705    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-243.ec2.internal" podStartSLOduration=21.177700584 podStartE2EDuration="21.177700584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:28.137077556 +0000 UTC m=+5.660952275" watchObservedRunningTime="2026-08-04 12:27:45.177700584 +0000 UTC m=+22.701575310"
Aug 04 12:27:45.199310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.199273    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-87dc2" podStartSLOduration=7.940763459 podStartE2EDuration="22.199258142s" totalImagesPullingTime="14.258494683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:45.198723986 +0000 UTC m=+22.722598712" watchObservedRunningTime="2026-08-04 12:27:45.199258142 +0000 UTC m=+22.723132869"
Aug 04 12:27:45.220559 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.220503    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sggfd" podStartSLOduration=3.476884235 podStartE2EDuration="22.220482274s" totalImagesPullingTime="18.743598039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:45.220067402 +0000 UTC m=+22.743942128" watchObservedRunningTime="2026-08-04 12:27:45.220482274 +0000 UTC m=+22.744357004"
Aug 04 12:27:45.239182 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.239141    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ktqrt" podStartSLOduration=7.992804506 podStartE2EDuration="22.239127085s" totalImagesPullingTime="14.246322579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:45.238755616 +0000 UTC m=+22.762630354" watchObservedRunningTime="2026-08-04 12:27:45.239127085 +0000 UTC m=+22.763001848"
Aug 04 12:27:45.266677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:45.266636    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8mwcw" podStartSLOduration=3.485733534 podStartE2EDuration="22.26661993s" totalImagesPullingTime="18.780886396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:45.266023801 +0000 UTC m=+22.789898529" watchObservedRunningTime="2026-08-04 12:27:45.26661993 +0000 UTC m=+22.790494657"
Aug 04 12:27:46.171761 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.171586    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:27:46.172426 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.172199    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"7c05ffbc1f67a1482e1d9661ba4e92aebe5c5614445e07d1f05655cf8755ed47"}
Aug 04 12:27:46.172426 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.172280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"091e54404bad7e134bf022b61a61c9531539975664a8266657df7bd5e3b70a5f"}
Aug 04 12:27:46.172426 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.172335    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"e55716865b49067b090f829a0c0e2a873e4085b27297f839ee23ba283ab85730"}
Aug 04 12:27:46.172426 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.172381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"11b91f293af4e8cd5eebf8f212b607376f7199e9d3b1a6be24cb9d3229ed2306"}
Aug 04 12:27:46.173872 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.173816    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nr4p4" event={"ID":"9eecfeab-29a6-4d03-bf06-009184b3d5c8","Type":"ContainerStarted","Data":"91af30ee34244a899d2f337d57781cd00c01b5761b83e87c32ebb7c47942fb41"}
Aug 04 12:27:46.420160 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.420129    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 12:27:46.966544 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.966504    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:46.966774 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.966638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:46.966774 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.966505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:46.966774 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:46.966759    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:46.966947 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:46.966634    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:46.966947 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:46.966849    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:46.979488 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.979398    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T12:27:46.420154746Z","UUID":"a67802b6-ffd3-42c4-bef4-701380f46a0f","Handler":null,"Name":"","Endpoint":""}
Aug 04 12:27:46.980996 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.980974    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 12:27:46.981123 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:46.981018    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 12:27:47.178657 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:47.178618    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w" event={"ID":"51034303-db90-467c-a29b-58437e4a09de","Type":"ContainerStarted","Data":"87abf3b90bd6af56e81e5a6ef3ed4c8e0c2010c84efdac8c96c6e72d30511639"}
Aug 04 12:27:47.203756 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:47.203694    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nr4p4" podStartSLOduration=5.457568037 podStartE2EDuration="24.203674468s" totalImagesPullingTime="18.746106431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:47.202914166 +0000 UTC m=+24.726788893" watchObservedRunningTime="2026-08-04 12:27:47.203674468 +0000 UTC m=+24.727549196"
Aug 04 12:27:48.182719 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.182684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w" event={"ID":"51034303-db90-467c-a29b-58437e4a09de","Type":"ContainerStarted","Data":"423359b481dbadb9b20714205786290a373136c287bbb598ec9b63ece003bf4e"}
Aug 04 12:27:48.204348 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.204305    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9qm5w" podStartSLOduration=4.281631315 podStartE2EDuration="25.204289535s" totalImagesPullingTime="20.92265822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:48.203334552 +0000 UTC m=+25.727209302" watchObservedRunningTime="2026-08-04 12:27:48.204289535 +0000 UTC m=+25.728164244"
Aug 04 12:27:48.644792 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.644014    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:48.644792 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.644633    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:48.966997 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.966923    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:48.966997 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.966947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:48.966997 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:48.966965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:48.967258 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:48.967073    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:48.967258 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:48.967175    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:48.967361 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:48.967260    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:49.188011 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:49.187864    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:27:49.188413 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:49.188370    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"aa8f0045921cbe76595d04a76c680189120ae2f428345243a7bd00538a03c85f"}
Aug 04 12:27:49.524303 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:49.524218    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:49.524783 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:49.524767    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ktqrt"
Aug 04 12:27:50.192421 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:50.192371    2574 generic.go:356] "Generic (PLEG): container finished" podID="74cc9684-d953-4ee6-8e00-be68daddd2eb" containerID="a3313d73e0665861b5abd5ebea3722cb1b612f299f75990aeb3b893b96469ee0" exitCode=0
Aug 04 12:27:50.192965 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:50.192462    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerDied","Data":"a3313d73e0665861b5abd5ebea3722cb1b612f299f75990aeb3b893b96469ee0"}
Aug 04 12:27:50.966198 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:50.966161    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:50.966335 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:50.966161    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:50.966335 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:50.966259    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:50.966473 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:50.966330    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:50.966473 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:50.966424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:50.966580 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:50.966522    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:51.197970 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.197928    2574 generic.go:356] "Generic (PLEG): container finished" podID="74cc9684-d953-4ee6-8e00-be68daddd2eb" containerID="ac50a900db32c0a8d3cd9c60845e683a94853696e2530c110ef6710b190798f3" exitCode=0
Aug 04 12:27:51.198610 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.198014    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerDied","Data":"ac50a900db32c0a8d3cd9c60845e683a94853696e2530c110ef6710b190798f3"}
Aug 04 12:27:51.202365 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.202176    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:27:51.202791 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.202578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"04cb97d4249cf32a09518980c6b3d3d9352ad102adf6c5210ca012084fa6a927"}
Aug 04 12:27:51.203163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.202898    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:51.203163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.203018    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:51.203163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.203130    2574 scope.go:117] "RemoveContainer" containerID="10071c9189a2a096c53e5c9f6e02f6f86bd4bec9a770983d3dc0289d063a4425"
Aug 04 12:27:51.221968 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:51.221382    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:52.208781 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.208560    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:27:52.209153 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.209089    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" event={"ID":"39dccca5-3465-4b16-b9ed-81ab84241f24","Type":"ContainerStarted","Data":"f2f0cc0394a857ca222222573bf2a38e873efbe5812656ba59427cbd3f571d2a"}
Aug 04 12:27:52.209446 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.209423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:52.211542 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.211518    2574 generic.go:356] "Generic (PLEG): container finished" podID="74cc9684-d953-4ee6-8e00-be68daddd2eb" containerID="5fd5537c3420e9e0773cc45814867724a79a221ecb7495850f401064bf90c007" exitCode=0
Aug 04 12:27:52.211637 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.211551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerDied","Data":"5fd5537c3420e9e0773cc45814867724a79a221ecb7495850f401064bf90c007"}
Aug 04 12:27:52.225723 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.225704    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:27:52.248115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.248073    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj" podStartSLOduration=10.44358505 podStartE2EDuration="29.24806033s" totalImagesPullingTime="18.80447528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:52.246212029 +0000 UTC m=+29.770086755" watchObservedRunningTime="2026-08-04 12:27:52.24806033 +0000 UTC m=+29.771935056"
Aug 04 12:27:52.967684 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.967650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:52.967872 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.967777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:52.967872 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:52.967798    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:52.967980 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:52.967869    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:52.967980 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:52.967876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:52.967980 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:52.967953    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:53.583166 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:53.583118    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5sct2"]
Aug 04 12:27:53.583675 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:53.583243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:53.583675 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:53.583566    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:53.585332 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:53.585309    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drrfq"]
Aug 04 12:27:53.585467 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:53.585424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:53.585569 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:53.585548    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:53.586292 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:53.586272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cx2hk"]
Aug 04 12:27:53.586423 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:53.586333    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:53.586492 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:53.586428    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:54.966667 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:54.966618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:54.967094 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:54.966786    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:54.967094 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:54.966829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:54.967094 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:54.966939    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:55.967014 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:55.966762    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:55.967497 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:55.967054    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx2hk" podUID="475e4fe6-e118-45cd-9500-0ffa64212570"
Aug 04 12:27:56.761425 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:56.761375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:56.761534 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:56.761456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:56.761579 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.761533    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:56.761579 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.761550    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:56.761647 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.761614    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs podName:e1cb02e9-8c09-4a30-9c0d-6fd8710bd471 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:28.761596243 +0000 UTC m=+66.285470949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs") pod "network-metrics-daemon-drrfq" (UID: "e1cb02e9-8c09-4a30-9c0d-6fd8710bd471") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 12:27:56.761647 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.761631    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret podName:e6d05309-a5b9-4a01-878e-e4000488b9c5 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:28.761622821 +0000 UTC m=+66.285497527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret") pod "global-pull-secret-syncer-5sct2" (UID: "e6d05309-a5b9-4a01-878e-e4000488b9c5") : object "kube-system"/"original-pull-secret" not registered
Aug 04 12:27:56.862257 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:56.862217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:56.862473 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.862360    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 12:27:56.862473 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.862374    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 12:27:56.862473 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.862383    2574 projected.go:196] Error preparing data for projected volume kube-api-access-qxrv4 for pod openshift-network-diagnostics/network-check-target-cx2hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:56.862473 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.862458    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4 podName:475e4fe6-e118-45cd-9500-0ffa64212570 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:28.862444378 +0000 UTC m=+66.386319083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qxrv4" (UniqueName: "kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4") pod "network-check-target-cx2hk" (UID: "475e4fe6-e118-45cd-9500-0ffa64212570") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 12:27:56.966316 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:56.966230    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:56.966316 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:56.966279    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:56.966507 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.966365    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sct2" podUID="e6d05309-a5b9-4a01-878e-e4000488b9c5"
Aug 04 12:27:56.966541 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:56.966502    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drrfq" podUID="e1cb02e9-8c09-4a30-9c0d-6fd8710bd471"
Aug 04 12:27:57.227525 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.227425    2574 generic.go:356] "Generic (PLEG): container finished" podID="74cc9684-d953-4ee6-8e00-be68daddd2eb" containerID="3678853f11007428c1053fac9d39f2cf7d6d497495de79c1199bc40357ca0bfa" exitCode=0
Aug 04 12:27:57.227525 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.227482    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerDied","Data":"3678853f11007428c1053fac9d39f2cf7d6d497495de79c1199bc40357ca0bfa"}
Aug 04 12:27:57.787500 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.787472    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-243.ec2.internal" event="NodeReady"
Aug 04 12:27:57.787665 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.787581    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 12:27:57.827245 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.827210    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cd995997-k9gpk"]
Aug 04 12:27:57.842416 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.842365    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wmttw"]
Aug 04 12:27:57.842572 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.842475    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.846326 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.846295    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sgr6r\""
Aug 04 12:27:57.846478 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.846333    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 12:27:57.846478 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.846295    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 12:27:57.846478 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.846335    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 12:27:57.853453 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.853426    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 12:27:57.870719 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.870680    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4ktrj"]
Aug 04 12:27:57.870851 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.870796    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:57.873452 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.873431    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 12:27:57.873452 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.873454    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4v7x\""
Aug 04 12:27:57.873605 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.873458    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 12:27:57.892780 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.892748    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cd995997-k9gpk"]
Aug 04 12:27:57.892780 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.892780    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wmttw"]
Aug 04 12:27:57.892953 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.892797    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4ktrj"]
Aug 04 12:27:57.892953 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.892859    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:57.899017 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.898997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 12:27:57.899123 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.899059    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 12:27:57.899449 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.899436    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25txl\""
Aug 04 12:27:57.899523 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.899439    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 12:27:57.966774 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.966737    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:27:57.970219 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7db4r\" (UniqueName: \"kubernetes.io/projected/65e9e685-8283-408b-9305-28b3216b4768-kube-api-access-7db4r\") pod \"ingress-canary-4ktrj\" (UID: \"65e9e685-8283-408b-9305-28b3216b4768\") " pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:57.970219 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-trusted-ca\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgjt\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-kube-api-access-sdgjt\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7165c480-84bc-4f40-b6e1-443cf606bf88-tmp-dir\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:57.970455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-installation-pull-secrets\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-bound-sa-token\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970422    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm5bs\" (UniqueName: \"kubernetes.io/projected/7165c480-84bc-4f40-b6e1-443cf606bf88-kube-api-access-bm5bs\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:57.970455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970445    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-image-registry-private-configuration\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:57.970752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7165c480-84bc-4f40-b6e1-443cf606bf88-config-volume\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:57.970752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65e9e685-8283-408b-9305-28b3216b4768-cert\") pod \"ingress-canary-4ktrj\" (UID: \"65e9e685-8283-408b-9305-28b3216b4768\") " pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:57.970752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4e1756e-404d-44b5-a973-73e5e729cd27-ca-trust-extracted\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.970752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.970613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-certificates\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:57.972060 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.972036    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 12:27:57.972174 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.972089    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 12:27:57.972174 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:57.972089    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-st96r\""
Aug 04 12:27:58.071195 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7db4r\" (UniqueName: \"kubernetes.io/projected/65e9e685-8283-408b-9305-28b3216b4768-kube-api-access-7db4r\") pod \"ingress-canary-4ktrj\" (UID: \"65e9e685-8283-408b-9305-28b3216b4768\") " pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:58.071195 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-trusted-ca\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071195 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgjt\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-kube-api-access-sdgjt\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071195 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7165c480-84bc-4f40-b6e1-443cf606bf88-tmp-dir\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-installation-pull-secrets\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-bound-sa-token\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm5bs\" (UniqueName: \"kubernetes.io/projected/7165c480-84bc-4f40-b6e1-443cf606bf88-kube-api-access-bm5bs\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071306    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-image-registry-private-configuration\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7165c480-84bc-4f40-b6e1-443cf606bf88-config-volume\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071427    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65e9e685-8283-408b-9305-28b3216b4768-cert\") pod \"ingress-canary-4ktrj\" (UID: \"65e9e685-8283-408b-9305-28b3216b4768\") " pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4e1756e-404d-44b5-a973-73e5e729cd27-ca-trust-extracted\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-certificates\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.071490    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 12:27:58.071570 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.071513    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd995997-k9gpk: secret "image-registry-tls" not found
Aug 04 12:27:58.072137 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.071587    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls podName:c4e1756e-404d-44b5-a973-73e5e729cd27 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:58.571562697 +0000 UTC m=+36.095437402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls") pod "image-registry-cd995997-k9gpk" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27") : secret "image-registry-tls" not found
Aug 04 12:27:58.072137 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.071629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7165c480-84bc-4f40-b6e1-443cf606bf88-tmp-dir\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.072137 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.071719    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 12:27:58.072137 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.071766    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls podName:7165c480-84bc-4f40-b6e1-443cf606bf88 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:58.571750228 +0000 UTC m=+36.095624932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls") pod "dns-default-wmttw" (UID: "7165c480-84bc-4f40-b6e1-443cf606bf88") : secret "dns-default-metrics-tls" not found
Aug 04 12:27:58.072137 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.072065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-certificates\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.072137 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.072087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7165c480-84bc-4f40-b6e1-443cf606bf88-config-volume\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.072327 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.072149    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-trusted-ca\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.072327 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.072198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4e1756e-404d-44b5-a973-73e5e729cd27-ca-trust-extracted\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.076011 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.075986    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-image-registry-private-configuration\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.076011 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.075990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-installation-pull-secrets\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.076252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.075999    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65e9e685-8283-408b-9305-28b3216b4768-cert\") pod \"ingress-canary-4ktrj\" (UID: \"65e9e685-8283-408b-9305-28b3216b4768\") " pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:58.081470 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.081428    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-bound-sa-token\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.081698 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.081674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7db4r\" (UniqueName: \"kubernetes.io/projected/65e9e685-8283-408b-9305-28b3216b4768-kube-api-access-7db4r\") pod \"ingress-canary-4ktrj\" (UID: \"65e9e685-8283-408b-9305-28b3216b4768\") " pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:58.081820 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.081798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgjt\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-kube-api-access-sdgjt\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.081951 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.081935    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm5bs\" (UniqueName: \"kubernetes.io/projected/7165c480-84bc-4f40-b6e1-443cf606bf88-kube-api-access-bm5bs\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.200660 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.200629    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4ktrj"
Aug 04 12:27:58.232787 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.232762    2574 generic.go:356] "Generic (PLEG): container finished" podID="74cc9684-d953-4ee6-8e00-be68daddd2eb" containerID="e1c6f772dad84b7833d4e7ce588ca81ac823964e0cef82a590fa9f8616c8b26d" exitCode=0
Aug 04 12:27:58.233239 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.232803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerDied","Data":"e1c6f772dad84b7833d4e7ce588ca81ac823964e0cef82a590fa9f8616c8b26d"}
Aug 04 12:27:58.393653 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.393424    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4ktrj"]
Aug 04 12:27:58.396807 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:27:58.396780    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e9e685_8283_408b_9305_28b3216b4768.slice/crio-00c0f36d1fef66e6e23272a58e315c9fcb25aca870d364485ca493c17fcdf1a4 WatchSource:0}: Error finding container 00c0f36d1fef66e6e23272a58e315c9fcb25aca870d364485ca493c17fcdf1a4: Status 404 returned error can't find the container with id 00c0f36d1fef66e6e23272a58e315c9fcb25aca870d364485ca493c17fcdf1a4
Aug 04 12:27:58.576723 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.576632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:58.576723 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.576676    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:58.576929 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.576789    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 12:27:58.576929 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.576810    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 12:27:58.576929 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.576832    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd995997-k9gpk: secret "image-registry-tls" not found
Aug 04 12:27:58.576929 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.576843    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls podName:7165c480-84bc-4f40-b6e1-443cf606bf88 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:59.576828858 +0000 UTC m=+37.100703563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls") pod "dns-default-wmttw" (UID: "7165c480-84bc-4f40-b6e1-443cf606bf88") : secret "dns-default-metrics-tls" not found
Aug 04 12:27:58.576929 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:58.576884    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls podName:c4e1756e-404d-44b5-a973-73e5e729cd27 nodeName:}" failed. No retries permitted until 2026-08-04 12:27:59.576867356 +0000 UTC m=+37.100742082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls") pod "image-registry-cd995997-k9gpk" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27") : secret "image-registry-tls" not found
Aug 04 12:27:58.966705 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.966668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:27:58.966869 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.966839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:27:58.969740 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.969718    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 12:27:58.969881 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.969857    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2dbw\""
Aug 04 12:27:58.969949 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:58.969917    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 12:27:59.239512 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:59.239427    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" event={"ID":"74cc9684-d953-4ee6-8e00-be68daddd2eb","Type":"ContainerStarted","Data":"b50961c0ce3dcb600ed201486dd214ef89ba90b2886a166a111c7063166c0216"}
Aug 04 12:27:59.240686 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:59.240657    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4ktrj" event={"ID":"65e9e685-8283-408b-9305-28b3216b4768","Type":"ContainerStarted","Data":"00c0f36d1fef66e6e23272a58e315c9fcb25aca870d364485ca493c17fcdf1a4"}
Aug 04 12:27:59.272338 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:59.272277    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x5tzv" podStartSLOduration=7.837747585 podStartE2EDuration="36.272261167s" totalImagesPullingTime="28.434513582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:27:59.271688372 +0000 UTC m=+36.795563098" watchObservedRunningTime="2026-08-04 12:27:59.272261167 +0000 UTC m=+36.796135894"
Aug 04 12:27:59.584881 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:59.584798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:27:59.584881 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:27:59.584834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:27:59.585075 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:59.584960    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 12:27:59.585075 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:59.584966    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 12:27:59.585075 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:59.584984    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd995997-k9gpk: secret "image-registry-tls" not found
Aug 04 12:27:59.585075 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:59.585025    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls podName:7165c480-84bc-4f40-b6e1-443cf606bf88 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:01.585007233 +0000 UTC m=+39.108881952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls") pod "dns-default-wmttw" (UID: "7165c480-84bc-4f40-b6e1-443cf606bf88") : secret "dns-default-metrics-tls" not found
Aug 04 12:27:59.585075 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:27:59.585042    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls podName:c4e1756e-404d-44b5-a973-73e5e729cd27 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:01.58503309 +0000 UTC m=+39.108907796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls") pod "image-registry-cd995997-k9gpk" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27") : secret "image-registry-tls" not found
Aug 04 12:28:01.247349 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:01.247156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4ktrj" event={"ID":"65e9e685-8283-408b-9305-28b3216b4768","Type":"ContainerStarted","Data":"057ecf25985c901467e997d8759a3bf405ed1759b42020b68df68a00f3459c97"}
Aug 04 12:28:01.270710 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:01.268792    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4ktrj" podStartSLOduration=1.575769496 podStartE2EDuration="4.268771301s" totalImagesPullingTime="2.693001805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:01.267308314 +0000 UTC m=+38.791183046" watchObservedRunningTime="2026-08-04 12:28:01.268771301 +0000 UTC m=+38.792646029"
Aug 04 12:28:01.598770 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:01.598724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:01.598770 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:01.598770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:01.598990 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:01.598873    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 12:28:01.598990 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:01.598885    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 12:28:01.598990 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:01.598907    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd995997-k9gpk: secret "image-registry-tls" not found
Aug 04 12:28:01.598990 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:01.598924    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls podName:7165c480-84bc-4f40-b6e1-443cf606bf88 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:05.598910721 +0000 UTC m=+43.122785426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls") pod "dns-default-wmttw" (UID: "7165c480-84bc-4f40-b6e1-443cf606bf88") : secret "dns-default-metrics-tls" not found
Aug 04 12:28:01.598990 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:01.598957    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls podName:c4e1756e-404d-44b5-a973-73e5e729cd27 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:05.598939468 +0000 UTC m=+43.122814196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls") pod "image-registry-cd995997-k9gpk" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27") : secret "image-registry-tls" not found
Aug 04 12:28:05.629908 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:05.629872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:05.629908 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:05.629912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:05.630309 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:05.630012    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 12:28:05.630309 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:05.630022    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 12:28:05.630309 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:05.630042    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd995997-k9gpk: secret "image-registry-tls" not found
Aug 04 12:28:05.630309 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:05.630073    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls podName:7165c480-84bc-4f40-b6e1-443cf606bf88 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:13.630060354 +0000 UTC m=+51.153935060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls") pod "dns-default-wmttw" (UID: "7165c480-84bc-4f40-b6e1-443cf606bf88") : secret "dns-default-metrics-tls" not found
Aug 04 12:28:05.630309 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:05.630092    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls podName:c4e1756e-404d-44b5-a973-73e5e729cd27 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:13.630078846 +0000 UTC m=+51.153953551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls") pod "image-registry-cd995997-k9gpk" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27") : secret "image-registry-tls" not found
Aug 04 12:28:06.041946 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.041874    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d2lqj"]
Aug 04 12:28:06.071687 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.071653    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d2lqj"]
Aug 04 12:28:06.071833 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.071773    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.080309 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.080279    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 12:28:06.080450 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.080278    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 12:28:06.080450 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.080437    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 12:28:06.080640 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.080625    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 12:28:06.080705 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.080627    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4bx8n\""
Aug 04 12:28:06.234484 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.234450    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4ts\" (UniqueName: \"kubernetes.io/projected/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-api-access-fr4ts\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.234484 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.234484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.234739 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.234513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-data-volume\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.234739 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.234643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-crio-socket\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.234739 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.234678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.335635 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.335603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4ts\" (UniqueName: \"kubernetes.io/projected/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-api-access-fr4ts\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.335805 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.335645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.335805 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.335678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-data-volume\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.335805 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.335756    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-crio-socket\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.335805 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.335759    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:06.335805 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.335782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.336011 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.335831    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:06.835815625 +0000 UTC m=+44.359690335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:06.336011 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.335863    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 12:28:06.336011 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.335921    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:06.835903722 +0000 UTC m=+44.359778444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : configmap "kube-rbac-proxy" not found
Aug 04 12:28:06.336011 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.335958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-crio-socket\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.336137 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.336032    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-data-volume\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.346781 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.346755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4ts\" (UniqueName: \"kubernetes.io/projected/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-api-access-fr4ts\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.840222 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.840190    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.840600 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.840270    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:06.840600 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.840336    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 12:28:06.840600 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.840340    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:06.840600 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.840425    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:07.84038271 +0000 UTC m=+45.364257416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : configmap "kube-rbac-proxy" not found
Aug 04 12:28:06.840600 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:06.840439    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:07.840433402 +0000 UTC m=+45.364308107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:06.855757 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.855724    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"]
Aug 04 12:28:06.888922 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.888887    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"]
Aug 04 12:28:06.889059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.888984    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"
Aug 04 12:28:06.892280 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.892255    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 12:28:06.892424 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.892362    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 12:28:06.892489 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:06.892445    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jdp6r\""
Aug 04 12:28:07.042503 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.042467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljtcn\" (UniqueName: \"kubernetes.io/projected/3625ffe9-3ad5-4416-91f6-234238685caf-kube-api-access-ljtcn\") pod \"migrator-68bc745d87-bqfmh\" (UID: \"3625ffe9-3ad5-4416-91f6-234238685caf\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"
Aug 04 12:28:07.143664 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.143587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljtcn\" (UniqueName: \"kubernetes.io/projected/3625ffe9-3ad5-4416-91f6-234238685caf-kube-api-access-ljtcn\") pod \"migrator-68bc745d87-bqfmh\" (UID: \"3625ffe9-3ad5-4416-91f6-234238685caf\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"
Aug 04 12:28:07.153562 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.153546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljtcn\" (UniqueName: \"kubernetes.io/projected/3625ffe9-3ad5-4416-91f6-234238685caf-kube-api-access-ljtcn\") pod \"migrator-68bc745d87-bqfmh\" (UID: \"3625ffe9-3ad5-4416-91f6-234238685caf\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"
Aug 04 12:28:07.197623 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.197594    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"
Aug 04 12:28:07.364060 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.364005    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh"]
Aug 04 12:28:07.367811 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:07.367783    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3625ffe9_3ad5_4416_91f6_234238685caf.slice/crio-f9f835f630d6ab43d8fab3b5a4734750a890f671bd5817e88f08479237034b30 WatchSource:0}: Error finding container f9f835f630d6ab43d8fab3b5a4734750a890f671bd5817e88f08479237034b30: Status 404 returned error can't find the container with id f9f835f630d6ab43d8fab3b5a4734750a890f671bd5817e88f08479237034b30
Aug 04 12:28:07.590419 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.590364    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-87dc2_6281c301-ef47-422b-98a5-290e9a7cffd0/dns-node-resolver/0.log"
Aug 04 12:28:07.849703 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.849610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:07.849703 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:07.849695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:07.850131 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:07.849736    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 12:28:07.850131 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:07.849821    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:09.84980539 +0000 UTC m=+47.373680099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : configmap "kube-rbac-proxy" not found
Aug 04 12:28:07.850131 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:07.849838    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:07.850131 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:07.849901    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:09.849883121 +0000 UTC m=+47.373757826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:08.266674 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:08.266593    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh" event={"ID":"3625ffe9-3ad5-4416-91f6-234238685caf","Type":"ContainerStarted","Data":"f9f835f630d6ab43d8fab3b5a4734750a890f671bd5817e88f08479237034b30"}
Aug 04 12:28:08.585466 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:08.585442    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sggfd_7c92c6f0-85a8-4660-92c7-5e9227510d32/node-ca/0.log"
Aug 04 12:28:09.144341 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.144314    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-6knmb"]
Aug 04 12:28:09.160916 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.160894    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-6knmb"]
Aug 04 12:28:09.161013 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.160984    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.164123 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.164104    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 04 12:28:09.164341 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.164321    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cxt6w\""
Aug 04 12:28:09.164452 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.164340    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 04 12:28:09.165634 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.165571    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 04 12:28:09.165746 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.165633    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 04 12:28:09.185115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.185091    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4ktrj_65e9e685-8283-408b-9305-28b3216b4768/serve-healthcheck-canary/0.log"
Aug 04 12:28:09.261252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.261226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/588662e8-49fa-4349-bf23-2a8f9baf5e15-signing-key\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.261436 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.261265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xp8\" (UniqueName: \"kubernetes.io/projected/588662e8-49fa-4349-bf23-2a8f9baf5e15-kube-api-access-s6xp8\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.261436 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.261321    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/588662e8-49fa-4349-bf23-2a8f9baf5e15-signing-cabundle\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.270452 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.270428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh" event={"ID":"3625ffe9-3ad5-4416-91f6-234238685caf","Type":"ContainerStarted","Data":"4971a72cabd74f875c4212e54fcb9e1a748fc865acb79e1d8c5985bbc860bfa2"}
Aug 04 12:28:09.362042 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.362008    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/588662e8-49fa-4349-bf23-2a8f9baf5e15-signing-key\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.362042 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.362041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xp8\" (UniqueName: \"kubernetes.io/projected/588662e8-49fa-4349-bf23-2a8f9baf5e15-kube-api-access-s6xp8\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.362273 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.362079    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/588662e8-49fa-4349-bf23-2a8f9baf5e15-signing-cabundle\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.362713 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.362691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/588662e8-49fa-4349-bf23-2a8f9baf5e15-signing-cabundle\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.364471 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.364455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/588662e8-49fa-4349-bf23-2a8f9baf5e15-signing-key\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.371035 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.371016    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xp8\" (UniqueName: \"kubernetes.io/projected/588662e8-49fa-4349-bf23-2a8f9baf5e15-kube-api-access-s6xp8\") pod \"service-ca-98c88fbb5-6knmb\" (UID: \"588662e8-49fa-4349-bf23-2a8f9baf5e15\") " pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.469473 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.469435    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-6knmb"
Aug 04 12:28:09.609784 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.609748    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-6knmb"]
Aug 04 12:28:09.612343 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:09.612293    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588662e8_49fa_4349_bf23_2a8f9baf5e15.slice/crio-c21ba1bc10612a239233e91f2c0894498e0268ef38147e1856469c783ca6e6af WatchSource:0}: Error finding container c21ba1bc10612a239233e91f2c0894498e0268ef38147e1856469c783ca6e6af: Status 404 returned error can't find the container with id c21ba1bc10612a239233e91f2c0894498e0268ef38147e1856469c783ca6e6af
Aug 04 12:28:09.866693 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.866611    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:09.866693 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.866672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:09.866868 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:09.866771    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:09.866868 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:09.866824    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:13.866808724 +0000 UTC m=+51.390683428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:09.867184 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:09.867161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:10.275680 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:10.275209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh" event={"ID":"3625ffe9-3ad5-4416-91f6-234238685caf","Type":"ContainerStarted","Data":"5ad469ab7c78e4b127266522b140901a21541b1035a5961db97785b155adeeeb"}
Aug 04 12:28:10.276514 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:10.276488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-6knmb" event={"ID":"588662e8-49fa-4349-bf23-2a8f9baf5e15","Type":"ContainerStarted","Data":"c21ba1bc10612a239233e91f2c0894498e0268ef38147e1856469c783ca6e6af"}
Aug 04 12:28:10.298558 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:10.298418    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-bqfmh" podStartSLOduration=2.5887983869999998 podStartE2EDuration="4.298369665s" totalImagesPullingTime="1.709571278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:10.297419169 +0000 UTC m=+47.821293900" watchObservedRunningTime="2026-08-04 12:28:10.298369665 +0000 UTC m=+47.822244393"
Aug 04 12:28:12.283893 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:12.283845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-6knmb" event={"ID":"588662e8-49fa-4349-bf23-2a8f9baf5e15","Type":"ContainerStarted","Data":"abe460aee1d1553237ffd7a391b57cf356aea89e6c3dc858899371334b6ad106"}
Aug 04 12:28:12.308125 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:12.308069    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-6knmb" podStartSLOduration=1.256066107 podStartE2EDuration="3.308056474s" totalImagesPullingTime="2.051990367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:12.30793582 +0000 UTC m=+49.831810547" watchObservedRunningTime="2026-08-04 12:28:12.308056474 +0000 UTC m=+49.831931212"
Aug 04 12:28:13.697004 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:13.696961    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:13.697471 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:13.697014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:13.697471 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.697158    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 12:28:13.697471 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.697218    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls podName:7165c480-84bc-4f40-b6e1-443cf606bf88 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:29.697200785 +0000 UTC m=+67.221075490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls") pod "dns-default-wmttw" (UID: "7165c480-84bc-4f40-b6e1-443cf606bf88") : secret "dns-default-metrics-tls" not found
Aug 04 12:28:13.697661 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.697640    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 12:28:13.697832 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.697809    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd995997-k9gpk: secret "image-registry-tls" not found
Aug 04 12:28:13.697962 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.697885    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls podName:c4e1756e-404d-44b5-a973-73e5e729cd27 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:29.697864823 +0000 UTC m=+67.221739530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls") pod "image-registry-cd995997-k9gpk" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27") : secret "image-registry-tls" not found
Aug 04 12:28:13.899012 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:13.898967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:13.899220 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.899203    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:13.899280 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:13.899270    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls podName:cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6 nodeName:}" failed. No retries permitted until 2026-08-04 12:28:21.899251263 +0000 UTC m=+59.423125988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2lqj" (UID: "cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6") : secret "insights-runtime-extractor-tls" not found
Aug 04 12:28:21.966508 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:21.966463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:21.968861 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:21.968843    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2lqj\" (UID: \"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6\") " pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:21.980064 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:21.980040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d2lqj"
Aug 04 12:28:22.106443 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:22.106405    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d2lqj"]
Aug 04 12:28:22.109325 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:22.109293    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbf5d96_56e0_4342_9ab1_ee6a7e2720e6.slice/crio-312825a85bfacb73a2fb8bf57c59a9dcd6cae30b3482d4edfbe3b43bf6665c6e WatchSource:0}: Error finding container 312825a85bfacb73a2fb8bf57c59a9dcd6cae30b3482d4edfbe3b43bf6665c6e: Status 404 returned error can't find the container with id 312825a85bfacb73a2fb8bf57c59a9dcd6cae30b3482d4edfbe3b43bf6665c6e
Aug 04 12:28:22.318447 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:22.318339    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2lqj" event={"ID":"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6","Type":"ContainerStarted","Data":"451e3577505a5ce9fd055c35adfd04c7966214cb1a8b3de5a0fd3bdd2a69bc86"}
Aug 04 12:28:22.318447 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:22.318439    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2lqj" event={"ID":"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6","Type":"ContainerStarted","Data":"312825a85bfacb73a2fb8bf57c59a9dcd6cae30b3482d4edfbe3b43bf6665c6e"}
Aug 04 12:28:23.322465 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:23.322429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2lqj" event={"ID":"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6","Type":"ContainerStarted","Data":"36a07da989cca07137df4acbc0f956b43323f6a73b64ba44ad18ca74bf7d446e"}
Aug 04 12:28:24.228352 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:24.228324    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88ncj"
Aug 04 12:28:25.330944 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:25.330908    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2lqj" event={"ID":"cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6","Type":"ContainerStarted","Data":"b84c9f4d0b1a3d36fd4b9a48c07a10f807f58c4fcdaafbcde8ebbb7c2a3be450"}
Aug 04 12:28:25.352972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:25.352918    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d2lqj" podStartSLOduration=17.30616283 podStartE2EDuration="19.352899695s" totalImagesPullingTime="2.046736865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:28:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:25.351896571 +0000 UTC m=+62.875771290" watchObservedRunningTime="2026-08-04 12:28:25.352899695 +0000 UTC m=+62.876774400"
Aug 04 12:28:28.811552 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.811512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:28:28.812080 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.811570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:28:28.815203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.815181    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 12:28:28.816362 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.816346    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 12:28:28.824848 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.824826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6d05309-a5b9-4a01-878e-e4000488b9c5-original-pull-secret\") pod \"global-pull-secret-syncer-5sct2\" (UID: \"e6d05309-a5b9-4a01-878e-e4000488b9c5\") " pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:28:28.824848 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.824847    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1cb02e9-8c09-4a30-9c0d-6fd8710bd471-metrics-certs\") pod \"network-metrics-daemon-drrfq\" (UID: \"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471\") " pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:28:28.912532 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.912495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:28:28.916187 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.916169    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 12:28:28.925690 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.925675    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 12:28:28.935689 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.935658    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxrv4\" (UniqueName: \"kubernetes.io/projected/475e4fe6-e118-45cd-9500-0ffa64212570-kube-api-access-qxrv4\") pod \"network-check-target-cx2hk\" (UID: \"475e4fe6-e118-45cd-9500-0ffa64212570\") " pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:28:28.976789 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.976763    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sct2"
Aug 04 12:28:28.984236 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.984217    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2dbw\""
Aug 04 12:28:28.991369 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:28.991347    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drrfq"
Aug 04 12:28:29.109874 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.109727    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5sct2"]
Aug 04 12:28:29.114630 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:29.114604    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d05309_a5b9_4a01_878e_e4000488b9c5.slice/crio-3713651b8ed0a1f9bebbed507521d9fd962262593b8576e1ddca5e82b0e5c1af WatchSource:0}: Error finding container 3713651b8ed0a1f9bebbed507521d9fd962262593b8576e1ddca5e82b0e5c1af: Status 404 returned error can't find the container with id 3713651b8ed0a1f9bebbed507521d9fd962262593b8576e1ddca5e82b0e5c1af
Aug 04 12:28:29.125496 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.125472    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drrfq"]
Aug 04 12:28:29.128750 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:29.128722    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cb02e9_8c09_4a30_9c0d_6fd8710bd471.slice/crio-56877871e3fa10876c62bbc270de75c0491c7496e2e571bfa13d8480404609c5 WatchSource:0}: Error finding container 56877871e3fa10876c62bbc270de75c0491c7496e2e571bfa13d8480404609c5: Status 404 returned error can't find the container with id 56877871e3fa10876c62bbc270de75c0491c7496e2e571bfa13d8480404609c5
Aug 04 12:28:29.177987 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.177956    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-st96r\""
Aug 04 12:28:29.186280 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.186263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:28:29.310728 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.310698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cx2hk"]
Aug 04 12:28:29.313424 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:29.313383    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475e4fe6_e118_45cd_9500_0ffa64212570.slice/crio-5377d2da2606048bc7a0164f4da914a443f6d350327ca4bc6e38eb8e8c21e7af WatchSource:0}: Error finding container 5377d2da2606048bc7a0164f4da914a443f6d350327ca4bc6e38eb8e8c21e7af: Status 404 returned error can't find the container with id 5377d2da2606048bc7a0164f4da914a443f6d350327ca4bc6e38eb8e8c21e7af
Aug 04 12:28:29.344071 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.344037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5sct2" event={"ID":"e6d05309-a5b9-4a01-878e-e4000488b9c5","Type":"ContainerStarted","Data":"3713651b8ed0a1f9bebbed507521d9fd962262593b8576e1ddca5e82b0e5c1af"}
Aug 04 12:28:29.345203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.345179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cx2hk" event={"ID":"475e4fe6-e118-45cd-9500-0ffa64212570","Type":"ContainerStarted","Data":"5377d2da2606048bc7a0164f4da914a443f6d350327ca4bc6e38eb8e8c21e7af"}
Aug 04 12:28:29.346168 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.346149    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drrfq" event={"ID":"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471","Type":"ContainerStarted","Data":"56877871e3fa10876c62bbc270de75c0491c7496e2e571bfa13d8480404609c5"}
Aug 04 12:28:29.453965 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.453935    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"]
Aug 04 12:28:29.457639 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.457618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.464266 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.464235    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 12:28:29.464266 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.464262    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 04 12:28:29.464462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.464278    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xstrn\""
Aug 04 12:28:29.464816 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.464598    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 12:28:29.465044 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.465016    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 12:28:29.476283 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.476259    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"]
Aug 04 12:28:29.479009 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.478994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.486196 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.486179    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 12:28:29.488720 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.488703    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 12:28:29.490489 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.490475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 12:28:29.500579 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.500557    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 12:28:29.501383 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.501364    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"]
Aug 04 12:28:29.517038 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.517159 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-ca\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.517159 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4htlq\" (UniqueName: \"kubernetes.io/projected/dda082a6-73b6-4a05-809e-a043e1c3359d-kube-api-access-4htlq\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.517159 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578f846674-lcfzf\" (UID: \"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.517273 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-hub\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.517318 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda082a6-73b6-4a05-809e-a043e1c3359d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.517356 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.517419 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.517356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7vp\" (UniqueName: \"kubernetes.io/projected/b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f-kube-api-access-nb7vp\") pod \"managed-serviceaccount-addon-agent-578f846674-lcfzf\" (UID: \"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.536633 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.536610    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"]
Aug 04 12:28:29.585597 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.585567    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cd995997-k9gpk"]
Aug 04 12:28:29.585870 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:29.585830    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-cd995997-k9gpk" podUID="c4e1756e-404d-44b5-a973-73e5e729cd27"
Aug 04 12:28:29.618374 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda082a6-73b6-4a05-809e-a043e1c3359d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.618374 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.618374 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7vp\" (UniqueName: \"kubernetes.io/projected/b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f-kube-api-access-nb7vp\") pod \"managed-serviceaccount-addon-agent-578f846674-lcfzf\" (UID: \"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.618718 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.618718 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-ca\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.618718 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4htlq\" (UniqueName: \"kubernetes.io/projected/dda082a6-73b6-4a05-809e-a043e1c3359d-kube-api-access-4htlq\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.618718 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578f846674-lcfzf\" (UID: \"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.618718 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.618565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-hub\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.619171 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.619143    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda082a6-73b6-4a05-809e-a043e1c3359d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.621365 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.621338    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-ca\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.621506 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.621441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-hub\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.621837 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.621815    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.621942 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.621920    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-578f846674-lcfzf\" (UID: \"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.622005 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.621980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dda082a6-73b6-4a05-809e-a043e1c3359d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.644947 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.644915    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7vp\" (UniqueName: \"kubernetes.io/projected/b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f-kube-api-access-nb7vp\") pod \"managed-serviceaccount-addon-agent-578f846674-lcfzf\" (UID: \"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.647561 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.647531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4htlq\" (UniqueName: \"kubernetes.io/projected/dda082a6-73b6-4a05-809e-a043e1c3359d-kube-api-access-4htlq\") pod \"cluster-proxy-proxy-agent-644d9cc964-rzdj2\" (UID: \"dda082a6-73b6-4a05-809e-a043e1c3359d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.693591 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.693561    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65fd976cf7-ds9ts"]
Aug 04 12:28:29.696729 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.696699    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.716541 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.715585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fd976cf7-ds9ts"]
Aug 04 12:28:29.719297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02ea687-e2ac-4e35-a97d-bbe636c264e7-installation-pull-secrets\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-registry-tls\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02ea687-e2ac-4e35-a97d-bbe636c264e7-ca-trust-extracted\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02ea687-e2ac-4e35-a97d-bbe636c264e7-trusted-ca\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:29.719297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02ea687-e2ac-4e35-a97d-bbe636c264e7-registry-certificates\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719686 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02ea687-e2ac-4e35-a97d-bbe636c264e7-image-registry-private-configuration\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719686 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719419    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:29.719686 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-bound-sa-token\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.719686 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.719482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bc2\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-kube-api-access-p5bc2\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.722246 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.722223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7165c480-84bc-4f40-b6e1-443cf606bf88-metrics-tls\") pod \"dns-default-wmttw\" (UID: \"7165c480-84bc-4f40-b6e1-443cf606bf88\") " pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:29.722701 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.722680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"image-registry-cd995997-k9gpk\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") " pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:29.774228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.774197    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"
Aug 04 12:28:29.787309 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.787282    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"
Aug 04 12:28:29.820975 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.820941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02ea687-e2ac-4e35-a97d-bbe636c264e7-image-registry-private-configuration\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.820975 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.820978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-bound-sa-token\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bc2\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-kube-api-access-p5bc2\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02ea687-e2ac-4e35-a97d-bbe636c264e7-installation-pull-secrets\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-registry-tls\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02ea687-e2ac-4e35-a97d-bbe636c264e7-ca-trust-extracted\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02ea687-e2ac-4e35-a97d-bbe636c264e7-trusted-ca\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02ea687-e2ac-4e35-a97d-bbe636c264e7-registry-certificates\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.821877 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821847    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f02ea687-e2ac-4e35-a97d-bbe636c264e7-ca-trust-extracted\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.822109 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.821979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f02ea687-e2ac-4e35-a97d-bbe636c264e7-registry-certificates\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.822655 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.822322    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f02ea687-e2ac-4e35-a97d-bbe636c264e7-trusted-ca\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.824275 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.824250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f02ea687-e2ac-4e35-a97d-bbe636c264e7-image-registry-private-configuration\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.824414 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.824364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f02ea687-e2ac-4e35-a97d-bbe636c264e7-installation-pull-secrets\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.825278 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.825256    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-registry-tls\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.831315 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.831287    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-bound-sa-token\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.832620 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.832594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bc2\" (UniqueName: \"kubernetes.io/projected/f02ea687-e2ac-4e35-a97d-bbe636c264e7-kube-api-access-p5bc2\") pod \"image-registry-65fd976cf7-ds9ts\" (UID: \"f02ea687-e2ac-4e35-a97d-bbe636c264e7\") " pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:29.982664 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.982377    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4v7x\""
Aug 04 12:28:29.989590 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:29.989315    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:30.026241 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.026208    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sgr6r\""
Aug 04 12:28:30.033710 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.033680    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:30.253328 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.250933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2"]
Aug 04 12:28:30.253328 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.251284    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wmttw"]
Aug 04 12:28:30.253537 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:30.253443    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddda082a6_73b6_4a05_809e_a043e1c3359d.slice/crio-170c22430cdcdbb67056a6ad95e45c332af8970163066fe143d804b16476846a WatchSource:0}: Error finding container 170c22430cdcdbb67056a6ad95e45c332af8970163066fe143d804b16476846a: Status 404 returned error can't find the container with id 170c22430cdcdbb67056a6ad95e45c332af8970163066fe143d804b16476846a
Aug 04 12:28:30.262367 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:30.262340    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7165c480_84bc_4f40_b6e1_443cf606bf88.slice/crio-f6f3876bb179d716a56b7a137c8a6b2dbcadba474fb63eb52aebc5308c6c1b9b WatchSource:0}: Error finding container f6f3876bb179d716a56b7a137c8a6b2dbcadba474fb63eb52aebc5308c6c1b9b: Status 404 returned error can't find the container with id f6f3876bb179d716a56b7a137c8a6b2dbcadba474fb63eb52aebc5308c6c1b9b
Aug 04 12:28:30.285203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.278908    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf"]
Aug 04 12:28:30.351517 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.351482    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf" event={"ID":"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f","Type":"ContainerStarted","Data":"bc950f61def7c34b7ac1a9e59b3ded2b621a00dab9480b0e281542f9d3b1e54f"}
Aug 04 12:28:30.354471 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.354441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wmttw" event={"ID":"7165c480-84bc-4f40-b6e1-443cf606bf88","Type":"ContainerStarted","Data":"f6f3876bb179d716a56b7a137c8a6b2dbcadba474fb63eb52aebc5308c6c1b9b"}
Aug 04 12:28:30.355888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.355841    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2" event={"ID":"dda082a6-73b6-4a05-809e-a043e1c3359d","Type":"ContainerStarted","Data":"170c22430cdcdbb67056a6ad95e45c332af8970163066fe143d804b16476846a"}
Aug 04 12:28:30.358991 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.358515    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:30.358991 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.358771    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drrfq" event={"ID":"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471","Type":"ContainerStarted","Data":"ac3ec75bb85ae8e81dfc0a7bdc83bef69d051d982d14211d4cb43f282e521fcf"}
Aug 04 12:28:30.375334 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.375218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:30.426732 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426699    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-image-registry-private-configuration\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.426864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426742    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdgjt\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-kube-api-access-sdgjt\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.426864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426784    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-trusted-ca\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.426864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426805    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4e1756e-404d-44b5-a973-73e5e729cd27-ca-trust-extracted\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.426864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426824    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-installation-pull-secrets\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.426864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426847    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.426864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426862    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-certificates\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.427183 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.426881    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-bound-sa-token\") pod \"c4e1756e-404d-44b5-a973-73e5e729cd27\" (UID: \"c4e1756e-404d-44b5-a973-73e5e729cd27\") "
Aug 04 12:28:30.428106 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.427411    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e1756e-404d-44b5-a973-73e5e729cd27-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:28:30.428106 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.427685    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:28:30.428106 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.428057    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:28:30.429567 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.429526    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:28:30.430308 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.430268    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:28:30.430581 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.430551    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:28:30.431360 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.431309    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-kube-api-access-sdgjt" (OuterVolumeSpecName: "kube-api-access-sdgjt") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "kube-api-access-sdgjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:28:30.431975 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.431940    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c4e1756e-404d-44b5-a973-73e5e729cd27" (UID: "c4e1756e-404d-44b5-a973-73e5e729cd27"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:28:30.490103 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.488784    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fd976cf7-ds9ts"]
Aug 04 12:28:30.493658 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:30.493625    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02ea687_e2ac_4e35_a97d_bbe636c264e7.slice/crio-811ac6943b0283442bfdd405d8961dbd01eae27f265da285f0e95d43c66bc964 WatchSource:0}: Error finding container 811ac6943b0283442bfdd405d8961dbd01eae27f265da285f0e95d43c66bc964: Status 404 returned error can't find the container with id 811ac6943b0283442bfdd405d8961dbd01eae27f265da285f0e95d43c66bc964
Aug 04 12:28:30.527614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527547    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-trusted-ca\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527573    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4e1756e-404d-44b5-a973-73e5e729cd27-ca-trust-extracted\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527588    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-installation-pull-secrets\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527601    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-tls\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527613    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4e1756e-404d-44b5-a973-73e5e729cd27-registry-certificates\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527854 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527624    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-bound-sa-token\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527854 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527638    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4e1756e-404d-44b5-a973-73e5e729cd27-image-registry-private-configuration\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:30.527854 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:30.527652    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdgjt\" (UniqueName: \"kubernetes.io/projected/c4e1756e-404d-44b5-a973-73e5e729cd27-kube-api-access-sdgjt\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:28:31.370727 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.370682    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drrfq" event={"ID":"e1cb02e9-8c09-4a30-9c0d-6fd8710bd471","Type":"ContainerStarted","Data":"46933905a7a6626e5cd6718ea7bac5d567158a6ff3e74f120c6904e23386c661"}
Aug 04 12:28:31.374322 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.374298    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd995997-k9gpk"
Aug 04 12:28:31.375183 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.375159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts" event={"ID":"f02ea687-e2ac-4e35-a97d-bbe636c264e7","Type":"ContainerStarted","Data":"fb02ddb1b3834382937b3d9934dfa45f61d4a7e742628c1bf383476dce934d81"}
Aug 04 12:28:31.375282 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.375203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts" event={"ID":"f02ea687-e2ac-4e35-a97d-bbe636c264e7","Type":"ContainerStarted","Data":"811ac6943b0283442bfdd405d8961dbd01eae27f265da285f0e95d43c66bc964"}
Aug 04 12:28:31.375282 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.375228    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:28:31.431743 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.431551    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-drrfq" podStartSLOduration=67.441882318 podStartE2EDuration="1m8.431382299s" totalImagesPullingTime="989.499981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:31.394759654 +0000 UTC m=+68.918634382" watchObservedRunningTime="2026-08-04 12:28:31.431382299 +0000 UTC m=+68.955257027"
Aug 04 12:28:31.448227 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.447538    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cd995997-k9gpk"]
Aug 04 12:28:31.449205 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:31.449180    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cd995997-k9gpk"]
Aug 04 12:28:32.972811 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:32.972772    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e1756e-404d-44b5-a973-73e5e729cd27" path="/var/lib/kubelet/pods/c4e1756e-404d-44b5-a973-73e5e729cd27/volumes"
Aug 04 12:28:39.414869 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.414826    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5sct2" event={"ID":"e6d05309-a5b9-4a01-878e-e4000488b9c5","Type":"ContainerStarted","Data":"28875bc173a3ecf8839f820aeb36474211b5d2d93c081ac62053cc5ccd2e75eb"}
Aug 04 12:28:39.416566 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.416538    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wmttw" event={"ID":"7165c480-84bc-4f40-b6e1-443cf606bf88","Type":"ContainerStarted","Data":"bf431edc02db29e655239150b09d006d068c77a2650a69d22c72b77f0fef08b1"}
Aug 04 12:28:39.416687 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.416590    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:39.416687 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.416608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wmttw" event={"ID":"7165c480-84bc-4f40-b6e1-443cf606bf88","Type":"ContainerStarted","Data":"50b92396ffa9c1cf7609471e40ba3d86172dc34371de64ea51d18e06efe79805"}
Aug 04 12:28:39.418602 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.418576    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2" event={"ID":"dda082a6-73b6-4a05-809e-a043e1c3359d","Type":"ContainerStarted","Data":"fb1e3f30e5f0f4ffe4172e175f9090c4066896a163454c0e1af9cb9c68069405"}
Aug 04 12:28:39.418671 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.418614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2" event={"ID":"dda082a6-73b6-4a05-809e-a043e1c3359d","Type":"ContainerStarted","Data":"1a093cc99c810c5a60f38b84ac81a1cb820f0c60c1057d9d0b694c0f01918ca1"}
Aug 04 12:28:39.418671 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.418629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2" event={"ID":"dda082a6-73b6-4a05-809e-a043e1c3359d","Type":"ContainerStarted","Data":"161852a9090f8cd04b279facbbbd3297d07619b985076b464bead4e538294be4"}
Aug 04 12:28:39.420115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.420093    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cx2hk" event={"ID":"475e4fe6-e118-45cd-9500-0ffa64212570","Type":"ContainerStarted","Data":"9a31738d5e5c3b26896957423cc6f77653f5756ee9a7385c83aaa15865c1cbce"}
Aug 04 12:28:39.420204 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.420136    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:28:39.421382 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.421364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf" event={"ID":"b4aec2bc-d27f-4458-bc5f-ca077ccdbc7f","Type":"ContainerStarted","Data":"eabf9bd23c447b47244d636893f2a8c296bee99cf959653bb74ea494ed4a3a49"}
Aug 04 12:28:39.434023 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.433981    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts" podStartSLOduration=10.433967398 podStartE2EDuration="10.433967398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:31.489319586 +0000 UTC m=+69.013194313" watchObservedRunningTime="2026-08-04 12:28:39.433967398 +0000 UTC m=+76.957842125"
Aug 04 12:28:39.434118 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.434077    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5sct2" podStartSLOduration=67.136792368 podStartE2EDuration="1m16.434073271s" totalImagesPullingTime="9.297280903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:39.433517776 +0000 UTC m=+76.957392503" watchObservedRunningTime="2026-08-04 12:28:39.434073271 +0000 UTC m=+76.957947998"
Aug 04 12:28:39.451956 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.451921    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cx2hk" podStartSLOduration=67.363796533 podStartE2EDuration="1m16.451906434s" totalImagesPullingTime="9.088109901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:39.451612197 +0000 UTC m=+76.975486924" watchObservedRunningTime="2026-08-04 12:28:39.451906434 +0000 UTC m=+76.975781165"
Aug 04 12:28:39.473092 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.473049    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wmttw" podStartSLOduration=34.342102939 podStartE2EDuration="42.473032771s" totalImagesPullingTime="8.130929832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:39.472318426 +0000 UTC m=+76.996193150" watchObservedRunningTime="2026-08-04 12:28:39.473032771 +0000 UTC m=+76.996907498"
Aug 04 12:28:39.490820 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.490774    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-578f846674-lcfzf" podStartSLOduration=2.368462841 podStartE2EDuration="10.490759622s" totalImagesPullingTime="8.122296781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:39.490349633 +0000 UTC m=+77.014224360" watchObservedRunningTime="2026-08-04 12:28:39.490759622 +0000 UTC m=+77.014634348"
Aug 04 12:28:39.511759 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:39.511716    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-644d9cc964-rzdj2" podStartSLOduration=2.344254862 podStartE2EDuration="10.511703245s" totalImagesPullingTime="8.167448383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:39.510736401 +0000 UTC m=+77.034611140" watchObservedRunningTime="2026-08-04 12:28:39.511703245 +0000 UTC m=+77.035577971"
Aug 04 12:28:44.871343 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.871218    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-72vn5"]
Aug 04 12:28:44.874958 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.874939    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.882690 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.882664    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 12:28:44.884336 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.883528    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 12:28:44.884336 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.883026    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gjl6d\""
Aug 04 12:28:44.884336 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.882944    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 12:28:44.884336 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.883916    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 12:28:44.884336 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.884186    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 12:28:44.884336 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.884244    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 12:28:44.930721 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a690ca01-6389-440d-a7a4-482bcace4edb-metrics-client-ca\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.930871 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-textfile\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.930871 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwrgs\" (UniqueName: \"kubernetes.io/projected/a690ca01-6389-440d-a7a4-482bcace4edb-kube-api-access-bwrgs\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.930991 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-accelerators-collector-config\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.930991 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-tls\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.930991 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-sys\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.931136 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.930989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-wtmp\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.931136 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.931065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:44.931136 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:44.931122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-root\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032270 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a690ca01-6389-440d-a7a4-482bcace4edb-metrics-client-ca\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032468 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-textfile\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032468 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032306    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwrgs\" (UniqueName: \"kubernetes.io/projected/a690ca01-6389-440d-a7a4-482bcace4edb-kube-api-access-bwrgs\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032468 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-accelerators-collector-config\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032468 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032375    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-tls\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032468 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-sys\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-wtmp\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032540    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-sys\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:45.032499    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-root\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:28:45.032623    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-tls podName:a690ca01-6389-440d-a7a4-482bcace4edb nodeName:}" failed. No retries permitted until 2026-08-04 12:28:45.53260135 +0000 UTC m=+83.056476068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-tls") pod "node-exporter-72vn5" (UID: "a690ca01-6389-440d-a7a4-482bcace4edb") : secret "node-exporter-tls" not found
Aug 04 12:28:45.032730 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032718    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-textfile\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.033004 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.032971    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-accelerators-collector-config\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.033068 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.033051    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-root\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.033159 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.033135    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-wtmp\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.033298 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.033253    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a690ca01-6389-440d-a7a4-482bcace4edb-metrics-client-ca\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.035072 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.035042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.044312 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.044288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwrgs\" (UniqueName: \"kubernetes.io/projected/a690ca01-6389-440d-a7a4-482bcace4edb-kube-api-access-bwrgs\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.536803 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.536764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-tls\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.539258 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.539237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a690ca01-6389-440d-a7a4-482bcace4edb-node-exporter-tls\") pod \"node-exporter-72vn5\" (UID: \"a690ca01-6389-440d-a7a4-482bcace4edb\") " pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.787307 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:45.787213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-72vn5"
Aug 04 12:28:45.805083 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:28:45.805052    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda690ca01_6389_440d_a7a4_482bcace4edb.slice/crio-f1e08dca07c8a56c64b99e448dac716d71b45b2c2c9eeb34dedc3261bd1a47f1 WatchSource:0}: Error finding container f1e08dca07c8a56c64b99e448dac716d71b45b2c2c9eeb34dedc3261bd1a47f1: Status 404 returned error can't find the container with id f1e08dca07c8a56c64b99e448dac716d71b45b2c2c9eeb34dedc3261bd1a47f1
Aug 04 12:28:46.445729 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:46.445693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-72vn5" event={"ID":"a690ca01-6389-440d-a7a4-482bcace4edb","Type":"ContainerStarted","Data":"f1e08dca07c8a56c64b99e448dac716d71b45b2c2c9eeb34dedc3261bd1a47f1"}
Aug 04 12:28:47.450240 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:47.450198    2574 generic.go:356] "Generic (PLEG): container finished" podID="a690ca01-6389-440d-a7a4-482bcace4edb" containerID="cb8ac12522e60899f1635702ed4a7a9c78ad405b74e77850d91610181ede1e07" exitCode=0
Aug 04 12:28:47.450610 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:47.450281    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-72vn5" event={"ID":"a690ca01-6389-440d-a7a4-482bcace4edb","Type":"ContainerDied","Data":"cb8ac12522e60899f1635702ed4a7a9c78ad405b74e77850d91610181ede1e07"}
Aug 04 12:28:48.456005 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:48.455967    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-72vn5" event={"ID":"a690ca01-6389-440d-a7a4-482bcace4edb","Type":"ContainerStarted","Data":"5a3f459e28d8bd19f4258e8025787701a8fa65c3ed2eadd87dfda47cc88a27b2"}
Aug 04 12:28:48.456378 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:48.456023    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-72vn5" event={"ID":"a690ca01-6389-440d-a7a4-482bcace4edb","Type":"ContainerStarted","Data":"f3411722c025b4a8ecb2a9a8f3cb8efb9bd1b9bd2fbaf55023be908a5b0645f5"}
Aug 04 12:28:48.479629 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:48.479588    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-72vn5" podStartSLOduration=3.338397857 podStartE2EDuration="4.479573128s" totalImagesPullingTime="1.070038065s" totalInitContainerRuntime="71.137206ms" isStatefulPod=true podCreationTimestamp="2026-08-04 12:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:28:48.479275402 +0000 UTC m=+86.003150133" watchObservedRunningTime="2026-08-04 12:28:48.479573128 +0000 UTC m=+86.003447855"
Aug 04 12:28:49.427574 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:49.427543    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wmttw"
Aug 04 12:28:50.038962 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:50.038930    2574 patch_prober.go:28] interesting pod/image-registry-65fd976cf7-ds9ts container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 12:28:50.039357 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:50.038985    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts" podUID="f02ea687-e2ac-4e35-a97d-bbe636c264e7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:28:52.388168 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:28:52.388141    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65fd976cf7-ds9ts"
Aug 04 12:29:10.427126 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:29:10.427095    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cx2hk"
Aug 04 12:32:22.898800 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:32:22.898770    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:32:22.903953 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:32:22.903928    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:32:22.904426 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:32:22.904377    2574 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 12:33:20.516493 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.516413    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"]
Aug 04 12:33:20.519358 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.519339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.521979 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.521960    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 04 12:33:20.522081 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.522011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5hqhm\""
Aug 04 12:33:20.522081 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.522023    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 04 12:33:20.533948 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.533924    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"]
Aug 04 12:33:20.679413 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.679356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d281c914-b087-47e0-8a20-83546747c15b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8znb6\" (UID: \"d281c914-b087-47e0-8a20-83546747c15b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.679592 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.679424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxhn6\" (UniqueName: \"kubernetes.io/projected/d281c914-b087-47e0-8a20-83546747c15b-kube-api-access-mxhn6\") pod \"cert-manager-operator-controller-manager-55c444bf86-8znb6\" (UID: \"d281c914-b087-47e0-8a20-83546747c15b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.780276 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.780182    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxhn6\" (UniqueName: \"kubernetes.io/projected/d281c914-b087-47e0-8a20-83546747c15b-kube-api-access-mxhn6\") pod \"cert-manager-operator-controller-manager-55c444bf86-8znb6\" (UID: \"d281c914-b087-47e0-8a20-83546747c15b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.780276 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.780264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d281c914-b087-47e0-8a20-83546747c15b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8znb6\" (UID: \"d281c914-b087-47e0-8a20-83546747c15b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.780657 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.780636    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d281c914-b087-47e0-8a20-83546747c15b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8znb6\" (UID: \"d281c914-b087-47e0-8a20-83546747c15b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.790435 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.790376    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxhn6\" (UniqueName: \"kubernetes.io/projected/d281c914-b087-47e0-8a20-83546747c15b-kube-api-access-mxhn6\") pod \"cert-manager-operator-controller-manager-55c444bf86-8znb6\" (UID: \"d281c914-b087-47e0-8a20-83546747c15b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.828284 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.828258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"
Aug 04 12:33:20.960582 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.960481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6"]
Aug 04 12:33:20.963297 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:33:20.963272    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd281c914_b087_47e0_8a20_83546747c15b.slice/crio-dad35bc90d661d72b465757545e7ea624b4bcb0ee36e7caa1926cb04c5d3445c WatchSource:0}: Error finding container dad35bc90d661d72b465757545e7ea624b4bcb0ee36e7caa1926cb04c5d3445c: Status 404 returned error can't find the container with id dad35bc90d661d72b465757545e7ea624b4bcb0ee36e7caa1926cb04c5d3445c
Aug 04 12:33:20.965862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:20.965847    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 12:33:21.357915 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:21.357884    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6" event={"ID":"d281c914-b087-47e0-8a20-83546747c15b","Type":"ContainerStarted","Data":"dad35bc90d661d72b465757545e7ea624b4bcb0ee36e7caa1926cb04c5d3445c"}
Aug 04 12:33:24.369926 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:24.369892    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6" event={"ID":"d281c914-b087-47e0-8a20-83546747c15b","Type":"ContainerStarted","Data":"6410d4fa380d1f09385e247593f24204c89af616a7d152295f734a706e6420a6"}
Aug 04 12:33:24.397433 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:33:24.397351    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8znb6" podStartSLOduration=1.057484729 podStartE2EDuration="4.397329238s" totalImagesPullingTime="3.339844509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:33:24.394145398 +0000 UTC m=+361.918020133" watchObservedRunningTime="2026-08-04 12:33:24.397329238 +0000 UTC m=+361.921203973"
Aug 04 12:34:02.527052 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.527018    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"]
Aug 04 12:34:02.533057 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.533036    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.536153 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.536123    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 12:34:02.536308 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.536130    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 12:34:02.536308 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.536154    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 12:34:02.536308 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.536267    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gzmtm\""
Aug 04 12:34:02.536595 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.536579    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 12:34:02.549849 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.549829    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"]
Aug 04 12:34:02.576282 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.576261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f59b07-6929-4e96-b960-ab5452fa84c7-manifests\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.576377 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.576290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f59b07-6929-4e96-b960-ab5452fa84c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.576377 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.576308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f59b07-6929-4e96-b960-ab5452fa84c7-tmp\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.576377 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.576325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f59b07-6929-4e96-b960-ab5452fa84c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.576527 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.576411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6297\" (UniqueName: \"kubernetes.io/projected/14f59b07-6929-4e96-b960-ab5452fa84c7-kube-api-access-d6297\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.677649 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.677626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f59b07-6929-4e96-b960-ab5452fa84c7-manifests\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.677759 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.677654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f59b07-6929-4e96-b960-ab5452fa84c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.677759 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.677672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f59b07-6929-4e96-b960-ab5452fa84c7-tmp\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.677759 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.677694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f59b07-6929-4e96-b960-ab5452fa84c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.677912 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.677827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6297\" (UniqueName: \"kubernetes.io/projected/14f59b07-6929-4e96-b960-ab5452fa84c7-kube-api-access-d6297\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.678029 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.678007    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f59b07-6929-4e96-b960-ab5452fa84c7-manifests\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.680055 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.680034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f59b07-6929-4e96-b960-ab5452fa84c7-tmp\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.680244 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.680222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f59b07-6929-4e96-b960-ab5452fa84c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.680290 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.680230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f59b07-6929-4e96-b960-ab5452fa84c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.689547 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.689524    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6297\" (UniqueName: \"kubernetes.io/projected/14f59b07-6929-4e96-b960-ab5452fa84c7-kube-api-access-d6297\") pod \"opendatahub-operator-controller-manager-547f69df5b-89nbm\" (UID: \"14f59b07-6929-4e96-b960-ab5452fa84c7\") " pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.843795 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.843768    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:02.978191 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:02.978170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"]
Aug 04 12:34:02.980962 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:02.980925    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f59b07_6929_4e96_b960_ab5452fa84c7.slice/crio-403fde09421888c4356df81e7cd3b71762ead1f5292cb70fdece75eb5fe2ffdd WatchSource:0}: Error finding container 403fde09421888c4356df81e7cd3b71762ead1f5292cb70fdece75eb5fe2ffdd: Status 404 returned error can't find the container with id 403fde09421888c4356df81e7cd3b71762ead1f5292cb70fdece75eb5fe2ffdd
Aug 04 12:34:03.506034 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:03.506001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm" event={"ID":"14f59b07-6929-4e96-b960-ab5452fa84c7","Type":"ContainerStarted","Data":"403fde09421888c4356df81e7cd3b71762ead1f5292cb70fdece75eb5fe2ffdd"}
Aug 04 12:34:07.524871 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:07.524828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm" event={"ID":"14f59b07-6929-4e96-b960-ab5452fa84c7","Type":"ContainerStarted","Data":"14a14f61d94fa98e33cafb9dd5504ef52f20af42b0e1c4de8938c974b31f15bc"}
Aug 04 12:34:08.530638 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:08.530603    2574 generic.go:356] "Generic (PLEG): container finished" podID="14f59b07-6929-4e96-b960-ab5452fa84c7" containerID="14a14f61d94fa98e33cafb9dd5504ef52f20af42b0e1c4de8938c974b31f15bc" exitCode=0
Aug 04 12:34:08.531027 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:08.530695    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm" event={"ID":"14f59b07-6929-4e96-b960-ab5452fa84c7","Type":"ContainerDied","Data":"14a14f61d94fa98e33cafb9dd5504ef52f20af42b0e1c4de8938c974b31f15bc"}
Aug 04 12:34:09.535742 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:09.535706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm" event={"ID":"14f59b07-6929-4e96-b960-ab5452fa84c7","Type":"ContainerStarted","Data":"09df9e6991b60e2bbdde66c6c5a44760f5dc2dfa51a21ea2059bb30d071e1caf"}
Aug 04 12:34:09.536131 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:09.535795    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:09.559565 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:09.559524    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm" podStartSLOduration=2.349508697 podStartE2EDuration="7.559508187s" totalImagesPullingTime="4.179587576s" totalInitContainerRuntime="1.030411914s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:09.557710876 +0000 UTC m=+407.081585615" watchObservedRunningTime="2026-08-04 12:34:09.559508187 +0000 UTC m=+407.083382918"
Aug 04 12:34:20.542494 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:20.542461    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547f69df5b-89nbm"
Aug 04 12:34:22.764070 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.764033    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"]
Aug 04 12:34:22.767233 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.767212    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.769796 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.769769    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 12:34:22.769933 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.769797    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 12:34:22.770898 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.770878    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 12:34:22.771018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.770906    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xdx9t\""
Aug 04 12:34:22.771018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.770955    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 12:34:22.780521 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.780497    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"]
Aug 04 12:34:22.796615 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.796583    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bfzhb"]
Aug 04 12:34:22.799706 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.799685    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:22.802432 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.802414    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pjzp8\""
Aug 04 12:34:22.802544 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.802452    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 04 12:34:22.812536 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.812514    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bfzhb"]
Aug 04 12:34:22.830064 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.830027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-tls-certs\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.830228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.830092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-tmp\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.830228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.830137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7g7\" (UniqueName: \"kubernetes.io/projected/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-kube-api-access-cv7g7\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.931037 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.931005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-tls-certs\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.931214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.931083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-tmp\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.931214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.931107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7g7\" (UniqueName: \"kubernetes.io/projected/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-kube-api-access-cv7g7\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.931214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.931139    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95xb7\" (UniqueName: \"kubernetes.io/projected/e9015005-308b-47be-a141-bd23512e2ad3-kube-api-access-95xb7\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:22.931214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.931159    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9015005-308b-47be-a141-bd23512e2ad3-cert\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:22.933613 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.933585    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-tmp\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.934223 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.934202    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 12:34:22.940748 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.940727    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 12:34:22.944253 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.944232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-tls-certs\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:22.951516 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.951497    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 12:34:22.961438 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:22.961413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7g7\" (UniqueName: \"kubernetes.io/projected/fcfd4d16-6fb7-4538-acad-9a6e4519d12f-kube-api-access-cv7g7\") pod \"kube-auth-proxy-5688595d9d-htlq7\" (UID: \"fcfd4d16-6fb7-4538-acad-9a6e4519d12f\") " pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:23.032158 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.032067    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95xb7\" (UniqueName: \"kubernetes.io/projected/e9015005-308b-47be-a141-bd23512e2ad3-kube-api-access-95xb7\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:23.032158 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.032106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9015005-308b-47be-a141-bd23512e2ad3-cert\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:23.036191 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.036170    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 04 12:34:23.042949 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:34:23.042932    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 04 12:34:23.043009 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:34:23.042998    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9015005-308b-47be-a141-bd23512e2ad3-cert podName:e9015005-308b-47be-a141-bd23512e2ad3 nodeName:}" failed. No retries permitted until 2026-08-04 12:34:23.542977919 +0000 UTC m=+421.066852638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e9015005-308b-47be-a141-bd23512e2ad3-cert") pod "odh-model-controller-7998c67dc4-bfzhb" (UID: "e9015005-308b-47be-a141-bd23512e2ad3") : secret "odh-model-controller-webhook-cert" not found
Aug 04 12:34:23.047685 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.047667    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95xb7\" (UniqueName: \"kubernetes.io/projected/e9015005-308b-47be-a141-bd23512e2ad3-kube-api-access-95xb7\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:23.079693 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.079669    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xdx9t\""
Aug 04 12:34:23.087456 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.087427    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"
Aug 04 12:34:23.237949 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.237878    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5688595d9d-htlq7"]
Aug 04 12:34:23.240049 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:23.240022    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfd4d16_6fb7_4538_acad_9a6e4519d12f.slice/crio-e857b92ae1e34961a55ddcf0f23e0419d119a2c6e5dbb6c9c2e12d29c714d328 WatchSource:0}: Error finding container e857b92ae1e34961a55ddcf0f23e0419d119a2c6e5dbb6c9c2e12d29c714d328: Status 404 returned error can't find the container with id e857b92ae1e34961a55ddcf0f23e0419d119a2c6e5dbb6c9c2e12d29c714d328
Aug 04 12:34:23.593736 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.593703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7" event={"ID":"fcfd4d16-6fb7-4538-acad-9a6e4519d12f","Type":"ContainerStarted","Data":"e857b92ae1e34961a55ddcf0f23e0419d119a2c6e5dbb6c9c2e12d29c714d328"}
Aug 04 12:34:23.637889 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.637853    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9015005-308b-47be-a141-bd23512e2ad3-cert\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:23.640335 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.640306    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9015005-308b-47be-a141-bd23512e2ad3-cert\") pod \"odh-model-controller-7998c67dc4-bfzhb\" (UID: \"e9015005-308b-47be-a141-bd23512e2ad3\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:23.711780 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.711743    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pjzp8\""
Aug 04 12:34:23.719985 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.719963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:23.744271 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.744241    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7bhvw"]
Aug 04 12:34:23.748019 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.747997    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:23.750731 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.750709    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 04 12:34:23.750842 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.750710    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kxg9q\""
Aug 04 12:34:23.759215 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.759187    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7bhvw"]
Aug 04 12:34:23.839919 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.839888    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:23.840265 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.839924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lfpd\" (UniqueName: \"kubernetes.io/projected/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-kube-api-access-5lfpd\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:23.854111 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.854035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bfzhb"]
Aug 04 12:34:23.856596 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:23.856572    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9015005_308b_47be_a141_bd23512e2ad3.slice/crio-899b822f013af70f9bdf9d5855de8663e578235b7841aa0a3920cbfca9605b78 WatchSource:0}: Error finding container 899b822f013af70f9bdf9d5855de8663e578235b7841aa0a3920cbfca9605b78: Status 404 returned error can't find the container with id 899b822f013af70f9bdf9d5855de8663e578235b7841aa0a3920cbfca9605b78
Aug 04 12:34:23.940761 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.940725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:23.940946 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.940779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lfpd\" (UniqueName: \"kubernetes.io/projected/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-kube-api-access-5lfpd\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:23.941172 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:34:23.941140    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Aug 04 12:34:23.941294 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:34:23.941231    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-tls-certs podName:8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e nodeName:}" failed. No retries permitted until 2026-08-04 12:34:24.441208662 +0000 UTC m=+421.965083416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-tls-certs") pod "model-serving-api-54d89bd5fc-7bhvw" (UID: "8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e") : secret "model-serving-api-tls" not found
Aug 04 12:34:23.966209 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:23.966179    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lfpd\" (UniqueName: \"kubernetes.io/projected/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-kube-api-access-5lfpd\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:24.058898 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.058858    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"]
Aug 04 12:34:24.062541 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.062516    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.065965 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.065947    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 12:34:24.066597 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.066573    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 12:34:24.067369 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.067286    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 12:34:24.067593 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.067578    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pxbkb\""
Aug 04 12:34:24.067665 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.067628    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 12:34:24.079732 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.079671    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"]
Aug 04 12:34:24.142526 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.142526 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.142751 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp42w\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-kube-api-access-rp42w\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.142751 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.142751 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.142751 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.142958 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.142768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243509 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243509 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243509 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243509 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243321    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.243864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.243832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp42w\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-kube-api-access-rp42w\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.244482 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.244426    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.246646 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.246621    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.246962 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.246939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.247115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.247055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.247188 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.247130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.253675 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.253636    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp42w\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-kube-api-access-rp42w\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.254946 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.254918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9jd75\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.376469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.376430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:24.446878 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.446319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:24.451906 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.451856    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7bhvw\" (UID: \"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:24.555357 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.555321    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"]
Aug 04 12:34:24.558514 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:24.558481    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409c7ffe_4f92_49ca_8f7c_5e2f9fd83e7d.slice/crio-9588fb6cf2541625d6eddb71593d596f54563741d0fb01fe6b495f88709460ee WatchSource:0}: Error finding container 9588fb6cf2541625d6eddb71593d596f54563741d0fb01fe6b495f88709460ee: Status 404 returned error can't find the container with id 9588fb6cf2541625d6eddb71593d596f54563741d0fb01fe6b495f88709460ee
Aug 04 12:34:24.600243 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.600159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb" event={"ID":"e9015005-308b-47be-a141-bd23512e2ad3","Type":"ContainerStarted","Data":"899b822f013af70f9bdf9d5855de8663e578235b7841aa0a3920cbfca9605b78"}
Aug 04 12:34:24.601812 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.601778    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" event={"ID":"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d","Type":"ContainerStarted","Data":"9588fb6cf2541625d6eddb71593d596f54563741d0fb01fe6b495f88709460ee"}
Aug 04 12:34:24.660970 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:24.660496    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:27.494056 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:27.494027    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 12:34:27.615470 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:27.615377    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7bhvw"]
Aug 04 12:34:27.745155 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:27.745070    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f79d0b7_0b5c_4b13_8a51_b0a65cdb747e.slice/crio-f6d663b631fc25f4d6830cc7ae5b27c97000d885e33dd08f90cd892470dc9576 WatchSource:0}: Error finding container f6d663b631fc25f4d6830cc7ae5b27c97000d885e33dd08f90cd892470dc9576: Status 404 returned error can't find the container with id f6d663b631fc25f4d6830cc7ae5b27c97000d885e33dd08f90cd892470dc9576
Aug 04 12:34:28.624304 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:28.624267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7" event={"ID":"fcfd4d16-6fb7-4538-acad-9a6e4519d12f","Type":"ContainerStarted","Data":"da28715980323b00f0b180d1d53574ee81ee44da687dc70765381553141be736"}
Aug 04 12:34:28.626037 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:28.626011    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb" event={"ID":"e9015005-308b-47be-a141-bd23512e2ad3","Type":"ContainerStarted","Data":"7c945e06d8d5abbcacfa7c5e6d16bff92c8c55cd67fa2ce99d8df44f56d98607"}
Aug 04 12:34:28.626178 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:28.626065    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:28.627254 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:28.627230    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw" event={"ID":"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e","Type":"ContainerStarted","Data":"f6d663b631fc25f4d6830cc7ae5b27c97000d885e33dd08f90cd892470dc9576"}
Aug 04 12:34:28.643628 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:28.643589    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5688595d9d-htlq7" podStartSLOduration=2.39488862 podStartE2EDuration="6.643573152s" totalImagesPullingTime="4.248684532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:28.643430978 +0000 UTC m=+426.167305705" watchObservedRunningTime="2026-08-04 12:34:28.643573152 +0000 UTC m=+426.167447881"
Aug 04 12:34:28.662239 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:28.662196    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb" podStartSLOduration=2.7573269700000003 podStartE2EDuration="6.662177108s" totalImagesPullingTime="3.904850138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:28.661819944 +0000 UTC m=+426.185694671" watchObservedRunningTime="2026-08-04 12:34:28.662177108 +0000 UTC m=+426.186051836"
Aug 04 12:34:29.742006 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:29.741964    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:34:29.742294 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:29.742035    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:34:30.637463 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.637419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw" event={"ID":"8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e","Type":"ContainerStarted","Data":"b88395f5e6bf89705e8f66b013bee0c4e801d8fe242bb9b986bca0e4440352d4"}
Aug 04 12:34:30.637650 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.637563    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:34:30.639001 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.638978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" event={"ID":"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d","Type":"ContainerStarted","Data":"addefda9adecdd6ed37a89eabd1d2b0c456134d7f39ab12ec55822fb9ecb2381"}
Aug 04 12:34:30.639166 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.639151    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:30.640734 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.640715    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-9jd75 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:34:30.640812 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.640766    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:34:30.674378 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:30.674309    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw" podStartSLOduration=5.6410205300000005 podStartE2EDuration="7.674287701s" totalImagesPullingTime="2.033267171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:30.67255273 +0000 UTC m=+428.196427458" watchObservedRunningTime="2026-08-04 12:34:30.674287701 +0000 UTC m=+428.198162434"
Aug 04 12:34:31.643992 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.643959    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-9jd75 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 12:34:31.644333 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.644030    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 12:34:31.915548 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.915456    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" podStartSLOduration=2.734772931 podStartE2EDuration="7.915437876s" totalImagesPullingTime="5.180664945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:30.727796582 +0000 UTC m=+428.251671322" watchObservedRunningTime="2026-08-04 12:34:31.915437876 +0000 UTC m=+429.439312607"
Aug 04 12:34:31.915829 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.915815    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"]
Aug 04 12:34:31.919135 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.919114    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:31.926216 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.926192    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4gx7g\""
Aug 04 12:34:31.987322 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:31.987283    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"]
Aug 04 12:34:32.016665 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016816 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4306c4b-2289-4942-98d6-8263b7a479a0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016816 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016816 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016800    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p224l\" (UniqueName: \"kubernetes.io/projected/c4306c4b-2289-4942-98d6-8263b7a479a0-kube-api-access-p224l\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016885    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.016940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.016900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.117996 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.117959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.117996 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4306c4b-2289-4942-98d6-8263b7a479a0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p224l\" (UniqueName: \"kubernetes.io/projected/c4306c4b-2289-4942-98d6-8263b7a479a0-kube-api-access-p224l\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118100    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118123    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118157    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118252 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118203    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118619 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118549    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118619 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118589    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118727 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118677    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.118782 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.118752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.119029 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.119009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4306c4b-2289-4942-98d6-8263b7a479a0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.120839 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.120812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.120981 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.120958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.132875 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.132851    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p224l\" (UniqueName: \"kubernetes.io/projected/c4306c4b-2289-4942-98d6-8263b7a479a0-kube-api-access-p224l\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.133277 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.133256    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4306c4b-2289-4942-98d6-8263b7a479a0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd\" (UID: \"c4306c4b-2289-4942-98d6-8263b7a479a0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.229854 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.229779    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:32.385571 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.385543    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"]
Aug 04 12:34:32.387192 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:32.387168    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4306c4b_2289_4942_98d6_8263b7a479a0.slice/crio-e0a602f9aef80523f53ce0fc119316e1eeee3430d9204bbc8b0efdb61d3fb400 WatchSource:0}: Error finding container e0a602f9aef80523f53ce0fc119316e1eeee3430d9204bbc8b0efdb61d3fb400: Status 404 returned error can't find the container with id e0a602f9aef80523f53ce0fc119316e1eeee3430d9204bbc8b0efdb61d3fb400
Aug 04 12:34:32.648910 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:32.648871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd" event={"ID":"c4306c4b-2289-4942-98d6-8263b7a479a0","Type":"ContainerStarted","Data":"e0a602f9aef80523f53ce0fc119316e1eeee3430d9204bbc8b0efdb61d3fb400"}
Aug 04 12:34:33.697207 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.697170    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"]
Aug 04 12:34:33.700805 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.700784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.704103 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.704066    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 12:34:33.706448 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.705438    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4c5tt\""
Aug 04 12:34:33.707952 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.707669    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"]
Aug 04 12:34:33.711480 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.711069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:33.712751 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.712730    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"]
Aug 04 12:34:33.714004 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.713984    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 12:34:33.714651 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.714632    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8mhhb\""
Aug 04 12:34:33.732249 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.731756    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"]
Aug 04 12:34:33.832973 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.832942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05d4b12a-25ab-4064-b169-3256d47a8f7f-cert\") pod \"kserve-controller-manager-d6f4b65b8-4qfm5\" (UID: \"05d4b12a-25ab-4064-b169-3256d47a8f7f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.833176 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.833006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrh4b\" (UniqueName: \"kubernetes.io/projected/05d4b12a-25ab-4064-b169-3256d47a8f7f-kube-api-access-jrh4b\") pod \"kserve-controller-manager-d6f4b65b8-4qfm5\" (UID: \"05d4b12a-25ab-4064-b169-3256d47a8f7f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.833176 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.833069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g58hh\" (UniqueName: \"kubernetes.io/projected/57507218-6147-4a87-99d6-af5fb5fccc89-kube-api-access-g58hh\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:33.833176 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.833110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57507218-6147-4a87-99d6-af5fb5fccc89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:33.934369 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.934305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57507218-6147-4a87-99d6-af5fb5fccc89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:33.934615 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.934410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05d4b12a-25ab-4064-b169-3256d47a8f7f-cert\") pod \"kserve-controller-manager-d6f4b65b8-4qfm5\" (UID: \"05d4b12a-25ab-4064-b169-3256d47a8f7f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.934615 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.934478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrh4b\" (UniqueName: \"kubernetes.io/projected/05d4b12a-25ab-4064-b169-3256d47a8f7f-kube-api-access-jrh4b\") pod \"kserve-controller-manager-d6f4b65b8-4qfm5\" (UID: \"05d4b12a-25ab-4064-b169-3256d47a8f7f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.934615 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.934541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g58hh\" (UniqueName: \"kubernetes.io/projected/57507218-6147-4a87-99d6-af5fb5fccc89-kube-api-access-g58hh\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:33.934847 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:34:33.934703    2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 04 12:34:33.934847 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:34:33.934794    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57507218-6147-4a87-99d6-af5fb5fccc89-cert podName:57507218-6147-4a87-99d6-af5fb5fccc89 nodeName:}" failed. No retries permitted until 2026-08-04 12:34:34.434766554 +0000 UTC m=+431.958641278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/57507218-6147-4a87-99d6-af5fb5fccc89-cert") pod "llmisvc-controller-manager-777c6bd7d5-rspm4" (UID: "57507218-6147-4a87-99d6-af5fb5fccc89") : secret "llmisvc-webhook-server-cert" not found
Aug 04 12:34:33.937656 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.937636    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05d4b12a-25ab-4064-b169-3256d47a8f7f-cert\") pod \"kserve-controller-manager-d6f4b65b8-4qfm5\" (UID: \"05d4b12a-25ab-4064-b169-3256d47a8f7f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.957857 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.957797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrh4b\" (UniqueName: \"kubernetes.io/projected/05d4b12a-25ab-4064-b169-3256d47a8f7f-kube-api-access-jrh4b\") pod \"kserve-controller-manager-d6f4b65b8-4qfm5\" (UID: \"05d4b12a-25ab-4064-b169-3256d47a8f7f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:33.963745 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:33.963713    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g58hh\" (UniqueName: \"kubernetes.io/projected/57507218-6147-4a87-99d6-af5fb5fccc89-kube-api-access-g58hh\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:34.017296 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.017250    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:34.182379 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.182282    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"]
Aug 04 12:34:34.313510 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.313421    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"]
Aug 04 12:34:34.313673 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.313604    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerName="discovery" containerID="cri-o://addefda9adecdd6ed37a89eabd1d2b0c456134d7f39ab12ec55822fb9ecb2381" gracePeriod=30
Aug 04 12:34:34.314492 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.314467    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:34.442344 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.442304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57507218-6147-4a87-99d6-af5fb5fccc89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:34.445060 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.445035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57507218-6147-4a87-99d6-af5fb5fccc89-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rspm4\" (UID: \"57507218-6147-4a87-99d6-af5fb5fccc89\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:34.634173 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.634136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:34.660997 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.660951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5" event={"ID":"05d4b12a-25ab-4064-b169-3256d47a8f7f","Type":"ContainerStarted","Data":"da3bd0eb8a6ee89b7d4c2a864856171ddaba51ad1e55fb3f1c5db899dc7eceb4"}
Aug 04 12:34:34.662803 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.662772    2574 generic.go:356] "Generic (PLEG): container finished" podID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerID="addefda9adecdd6ed37a89eabd1d2b0c456134d7f39ab12ec55822fb9ecb2381" exitCode=0
Aug 04 12:34:34.662942 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:34.662823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" event={"ID":"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d","Type":"ContainerDied","Data":"addefda9adecdd6ed37a89eabd1d2b0c456134d7f39ab12ec55822fb9ecb2381"}
Aug 04 12:34:35.402792 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.402752    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:34:35.403116 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.402825    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:34:35.403116 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.402854    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:34:35.491675 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.491647    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:35.496142 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.496111    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"]
Aug 04 12:34:35.499799 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:34:35.499769    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod57507218_6147_4a87_99d6_af5fb5fccc89.slice/crio-845e3f95066348547280023f53c6fff5de95e930fffaf3cb090207e7c6faf36e WatchSource:0}: Error finding container 845e3f95066348547280023f53c6fff5de95e930fffaf3cb090207e7c6faf36e: Status 404 returned error can't find the container with id 845e3f95066348547280023f53c6fff5de95e930fffaf3cb090207e7c6faf36e
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.652864    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-token\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.652936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-ca-configmap\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.652971    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-cacerts\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.653019    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp42w\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-kube-api-access-rp42w\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.653042    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-dns-cert\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.653113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-local-certs\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.653339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.653138    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-kubeconfig\") pod \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\" (UID: \"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d\") "
Aug 04 12:34:35.654636 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.654586    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:34:35.658793 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.658762    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:34:35.659217 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.659166    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:34:35.659297 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.659263    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-cacerts" (OuterVolumeSpecName: "cacerts") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:34:35.659696 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.659576    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:35.659696 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.659648    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-local-certs" (OuterVolumeSpecName: "local-certs") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:34:35.660635 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.660610    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-kube-api-access-rp42w" (OuterVolumeSpecName: "kube-api-access-rp42w") pod "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" (UID: "409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d"). InnerVolumeSpecName "kube-api-access-rp42w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:34:35.668836 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.668811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4" event={"ID":"57507218-6147-4a87-99d6-af5fb5fccc89","Type":"ContainerStarted","Data":"845e3f95066348547280023f53c6fff5de95e930fffaf3cb090207e7c6faf36e"}
Aug 04 12:34:35.670347 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.670327    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"
Aug 04 12:34:35.670455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.670350    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75" event={"ID":"409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d","Type":"ContainerDied","Data":"9588fb6cf2541625d6eddb71593d596f54563741d0fb01fe6b495f88709460ee"}
Aug 04 12:34:35.670455 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.670425    2574 scope.go:117] "RemoveContainer" containerID="addefda9adecdd6ed37a89eabd1d2b0c456134d7f39ab12ec55822fb9ecb2381"
Aug 04 12:34:35.673070 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.673042    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd" event={"ID":"c4306c4b-2289-4942-98d6-8263b7a479a0","Type":"ContainerStarted","Data":"40bc9ea5ab9ae0441c9c311bb2304a0546336cebf8f0031a0ea6c99191447a1b"}
Aug 04 12:34:35.707921 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.707874    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd" podStartSLOduration=1.694800316 podStartE2EDuration="4.707853755s" totalImagesPullingTime="3.013053439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:35.706299767 +0000 UTC m=+433.230174494" watchObservedRunningTime="2026-08-04 12:34:35.707853755 +0000 UTC m=+433.231728484"
Aug 04 12:34:35.722285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.722252    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"]
Aug 04 12:34:35.730060 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.730033    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9jd75"]
Aug 04 12:34:35.754688 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754660    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-token\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:35.754688 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754680    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-ca-configmap\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:35.754688 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754690    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-cacerts\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:35.754920 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754700    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp42w\" (UniqueName: \"kubernetes.io/projected/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-kube-api-access-rp42w\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:35.754920 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754709    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-csr-dns-cert\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:35.754920 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754717    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-local-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:35.754920 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:35.754726    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d-istio-kubeconfig\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:34:36.231051 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:36.231017    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:36.236036 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:36.236012    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:36.680582 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:36.680550    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:36.681674 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:36.681655    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd"
Aug 04 12:34:36.974059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:36.973980    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" path="/var/lib/kubelet/pods/409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d/volumes"
Aug 04 12:34:38.691270 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:38.691229    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5" event={"ID":"05d4b12a-25ab-4064-b169-3256d47a8f7f","Type":"ContainerStarted","Data":"9f6e3eaa75bf3efc0ac704820f9d3695a211beb74e417ba63b6f8f39800445c7"}
Aug 04 12:34:38.691759 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:38.691353    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:34:38.693027 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:38.693004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4" event={"ID":"57507218-6147-4a87-99d6-af5fb5fccc89","Type":"ContainerStarted","Data":"665d268d2505056135b51c7d39ff7b595ee40b2498d4ac27989c854686b772bc"}
Aug 04 12:34:38.693149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:38.693044    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:34:38.713377 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:38.713328    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5" podStartSLOduration=2.254487439 podStartE2EDuration="5.713314525s" totalImagesPullingTime="3.458827086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:38.712574223 +0000 UTC m=+436.236448951" watchObservedRunningTime="2026-08-04 12:34:38.713314525 +0000 UTC m=+436.237189252"
Aug 04 12:34:38.735897 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:38.735839    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4" podStartSLOduration=2.9311523839999998 podStartE2EDuration="5.735824873s" totalImagesPullingTime="2.804672489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:34:38.733891902 +0000 UTC m=+436.257766628" watchObservedRunningTime="2026-08-04 12:34:38.735824873 +0000 UTC m=+436.259699620"
Aug 04 12:34:39.634782 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:39.634748    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bfzhb"
Aug 04 12:34:41.647716 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:34:41.647688    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7bhvw"
Aug 04 12:35:09.699764 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:09.699735    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rspm4"
Aug 04 12:35:09.702806 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:09.702788    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4qfm5"
Aug 04 12:35:38.234517 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.234478    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"]
Aug 04 12:35:38.235009 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.234781    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerName="discovery"
Aug 04 12:35:38.235009 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.234792    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerName="discovery"
Aug 04 12:35:38.235009 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.234862    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="409c7ffe-4f92-49ca-8f7c-5e2f9fd83e7d" containerName="discovery"
Aug 04 12:35:38.238993 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.238973    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:38.242052 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.242032    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 12:35:38.243262 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.243246    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 12:35:38.243339 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.243300    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jtm55\""
Aug 04 12:35:38.252151 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.252119    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"]
Aug 04 12:35:38.374432 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.374360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwhg\" (UniqueName: \"kubernetes.io/projected/d39f2b85-48b7-4d3c-8f93-37421e44ac9b-kube-api-access-4qwhg\") pod \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" (UID: \"d39f2b85-48b7-4d3c-8f93-37421e44ac9b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:38.475642 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.475601    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwhg\" (UniqueName: \"kubernetes.io/projected/d39f2b85-48b7-4d3c-8f93-37421e44ac9b-kube-api-access-4qwhg\") pod \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" (UID: \"d39f2b85-48b7-4d3c-8f93-37421e44ac9b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:38.488171 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.488099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwhg\" (UniqueName: \"kubernetes.io/projected/d39f2b85-48b7-4d3c-8f93-37421e44ac9b-kube-api-access-4qwhg\") pod \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" (UID: \"d39f2b85-48b7-4d3c-8f93-37421e44ac9b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:38.549085 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.549028    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:38.687359 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.687334    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"]
Aug 04 12:35:38.690049 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:35:38.690025    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39f2b85_48b7_4d3c_8f93_37421e44ac9b.slice/crio-0da35f00deacfa2c1a69cc08758748a057429a01b46d50c5611d8b2bc98a8834 WatchSource:0}: Error finding container 0da35f00deacfa2c1a69cc08758748a057429a01b46d50c5611d8b2bc98a8834: Status 404 returned error can't find the container with id 0da35f00deacfa2c1a69cc08758748a057429a01b46d50c5611d8b2bc98a8834
Aug 04 12:35:38.931258 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:38.931216    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf" event={"ID":"d39f2b85-48b7-4d3c-8f93-37421e44ac9b","Type":"ContainerStarted","Data":"0da35f00deacfa2c1a69cc08758748a057429a01b46d50c5611d8b2bc98a8834"}
Aug 04 12:35:40.262692 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.262657    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"]
Aug 04 12:35:40.271224 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.271195    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:40.274473 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.274445    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 04 12:35:40.274588 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.274482    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dch25\""
Aug 04 12:35:40.278127 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.278100    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"]
Aug 04 12:35:40.291217 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.291182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9l5t\" (UniqueName: \"kubernetes.io/projected/03a50576-4d27-4c9f-8554-d708b59a1e20-kube-api-access-g9l5t\") pod \"dns-operator-controller-manager-5985564776-rh6sm\" (UID: \"03a50576-4d27-4c9f-8554-d708b59a1e20\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:40.391750 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.391695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9l5t\" (UniqueName: \"kubernetes.io/projected/03a50576-4d27-4c9f-8554-d708b59a1e20-kube-api-access-g9l5t\") pod \"dns-operator-controller-manager-5985564776-rh6sm\" (UID: \"03a50576-4d27-4c9f-8554-d708b59a1e20\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:40.403841 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.403810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9l5t\" (UniqueName: \"kubernetes.io/projected/03a50576-4d27-4c9f-8554-d708b59a1e20-kube-api-access-g9l5t\") pod \"dns-operator-controller-manager-5985564776-rh6sm\" (UID: \"03a50576-4d27-4c9f-8554-d708b59a1e20\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:40.584939 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:40.584833    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:41.168028 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:41.168003    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"]
Aug 04 12:35:41.171517 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:35:41.171484    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a50576_4d27_4c9f_8554_d708b59a1e20.slice/crio-920e8f7fc52d752dba46257a6dd197dce8aa9b873bd073250e8440c1ca3dab95 WatchSource:0}: Error finding container 920e8f7fc52d752dba46257a6dd197dce8aa9b873bd073250e8440c1ca3dab95: Status 404 returned error can't find the container with id 920e8f7fc52d752dba46257a6dd197dce8aa9b873bd073250e8440c1ca3dab95
Aug 04 12:35:41.948580 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:41.948537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf" event={"ID":"d39f2b85-48b7-4d3c-8f93-37421e44ac9b","Type":"ContainerStarted","Data":"f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b"}
Aug 04 12:35:41.949029 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:41.948613    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:41.950076 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:41.950050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm" event={"ID":"03a50576-4d27-4c9f-8554-d708b59a1e20","Type":"ContainerStarted","Data":"920e8f7fc52d752dba46257a6dd197dce8aa9b873bd073250e8440c1ca3dab95"}
Aug 04 12:35:41.971170 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:41.971117    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf" podStartSLOduration=1.5718998210000001 podStartE2EDuration="3.971100359s" totalImagesPullingTime="2.399200538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:35:41.970349318 +0000 UTC m=+499.494224045" watchObservedRunningTime="2026-08-04 12:35:41.971100359 +0000 UTC m=+499.494975086"
Aug 04 12:35:42.955924 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:42.955887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm" event={"ID":"03a50576-4d27-4c9f-8554-d708b59a1e20","Type":"ContainerStarted","Data":"eacced91c0969d54b2660b7f428ab0d47c59fc720470a7c5d20bef2ae6086047"}
Aug 04 12:35:42.956427 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:42.956238    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:42.991998 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:42.991935    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm" podStartSLOduration=1.419348989 podStartE2EDuration="2.991912832s" totalImagesPullingTime="1.572563843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:35:42.991871957 +0000 UTC m=+500.515746685" watchObservedRunningTime="2026-08-04 12:35:42.991912832 +0000 UTC m=+500.515787560"
Aug 04 12:35:43.591913 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.591881    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-42b2f"]
Aug 04 12:35:43.595153 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.595137    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:35:43.606983 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.606963    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h4jg2\""
Aug 04 12:35:43.611731 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.611706    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-42b2f"]
Aug 04 12:35:43.617421 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.617383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5dvk\" (UniqueName: \"kubernetes.io/projected/7fb3499a-d3d0-4580-85a8-583a32bd74d3-kube-api-access-h5dvk\") pod \"authorino-operator-68d88948d8-42b2f\" (UID: \"7fb3499a-d3d0-4580-85a8-583a32bd74d3\") " pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:35:43.718725 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.718685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5dvk\" (UniqueName: \"kubernetes.io/projected/7fb3499a-d3d0-4580-85a8-583a32bd74d3-kube-api-access-h5dvk\") pod \"authorino-operator-68d88948d8-42b2f\" (UID: \"7fb3499a-d3d0-4580-85a8-583a32bd74d3\") " pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:35:43.736233 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.736202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5dvk\" (UniqueName: \"kubernetes.io/projected/7fb3499a-d3d0-4580-85a8-583a32bd74d3-kube-api-access-h5dvk\") pod \"authorino-operator-68d88948d8-42b2f\" (UID: \"7fb3499a-d3d0-4580-85a8-583a32bd74d3\") " pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:35:43.905323 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:43.905233    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:35:44.047413 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:44.047371    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-42b2f"]
Aug 04 12:35:44.049331 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:35:44.049310    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb3499a_d3d0_4580_85a8_583a32bd74d3.slice/crio-fe11a5ddc784d77bed98900c041295bb4c637f60daf497d764f935e102f2c7e7 WatchSource:0}: Error finding container fe11a5ddc784d77bed98900c041295bb4c637f60daf497d764f935e102f2c7e7: Status 404 returned error can't find the container with id fe11a5ddc784d77bed98900c041295bb4c637f60daf497d764f935e102f2c7e7
Aug 04 12:35:44.971030 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:44.970996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f" event={"ID":"7fb3499a-d3d0-4580-85a8-583a32bd74d3","Type":"ContainerStarted","Data":"fe11a5ddc784d77bed98900c041295bb4c637f60daf497d764f935e102f2c7e7"}
Aug 04 12:35:46.976148 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:46.976112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f" event={"ID":"7fb3499a-d3d0-4580-85a8-583a32bd74d3","Type":"ContainerStarted","Data":"235232b08a9a0cf8619cd2ec81181ed095d8413dd19befbea7356de3f5ba5493"}
Aug 04 12:35:46.976633 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:46.976205    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:35:47.029555 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.029451    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f" podStartSLOduration=1.327064527 podStartE2EDuration="4.029432636s" totalImagesPullingTime="2.702368109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:35:47.028491958 +0000 UTC m=+504.552366684" watchObservedRunningTime="2026-08-04 12:35:47.029432636 +0000 UTC m=+504.553307362"
Aug 04 12:35:47.856487 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.856450    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"]
Aug 04 12:35:47.859617 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.859600    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:47.873111 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.873087    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vljjp\""
Aug 04 12:35:47.882271 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.882248    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"]
Aug 04 12:35:47.957179 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.957145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8l77\" (UniqueName: \"kubernetes.io/projected/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-kube-api-access-j8l77\") pod \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:47.957354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:47.957208    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:48.058259 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.058223    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8l77\" (UniqueName: \"kubernetes.io/projected/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-kube-api-access-j8l77\") pod \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:48.058649 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.058312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:48.058757 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.058738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:48.085404 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.085370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8l77\" (UniqueName: \"kubernetes.io/projected/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-kube-api-access-j8l77\") pod \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:48.173594 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.173504    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:48.327337 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.327303    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"]
Aug 04 12:35:48.328709 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:35:48.328685    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6db092_4a12_4fc1_b8c5_01e7a90bbb99.slice/crio-b045522cedd0eb2cb2e150df989a31dabd17d79d98916e505053e4d089ec6b3e WatchSource:0}: Error finding container b045522cedd0eb2cb2e150df989a31dabd17d79d98916e505053e4d089ec6b3e: Status 404 returned error can't find the container with id b045522cedd0eb2cb2e150df989a31dabd17d79d98916e505053e4d089ec6b3e
Aug 04 12:35:48.986902 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:48.986866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d" event={"ID":"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99","Type":"ContainerStarted","Data":"b045522cedd0eb2cb2e150df989a31dabd17d79d98916e505053e4d089ec6b3e"}
Aug 04 12:35:52.958410 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:52.958347    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:35:53.008619 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:53.008584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d" event={"ID":"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99","Type":"ContainerStarted","Data":"492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb"}
Aug 04 12:35:53.008783 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:53.008736    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:35:53.038894 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:53.038845    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d" podStartSLOduration=2.328558505 podStartE2EDuration="6.038821764s" totalImagesPullingTime="3.710263259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:35:53.034038394 +0000 UTC m=+510.557913122" watchObservedRunningTime="2026-08-04 12:35:53.038821764 +0000 UTC m=+510.562696492"
Aug 04 12:35:54.972524 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:54.972496    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-rh6sm"
Aug 04 12:35:57.983699 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:35:57.983669    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-42b2f"
Aug 04 12:36:04.015820 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:04.015788    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:05.133915 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.133881    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"]
Aug 04 12:36:05.140473 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.140448    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.152075 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.152046    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"]
Aug 04 12:36:05.222021 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.221983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2vx\" (UniqueName: \"kubernetes.io/projected/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-kube-api-access-bg2vx\") pod \"kuadrant-operator-controller-manager-96db98c47-5khzv\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.222167 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.222039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-5khzv\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.260315 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.260277    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"]
Aug 04 12:36:05.260573 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.260553    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-bg2vx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643"
Aug 04 12:36:05.322677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.322640    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2vx\" (UniqueName: \"kubernetes.io/projected/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-kube-api-access-bg2vx\") pod \"kuadrant-operator-controller-manager-96db98c47-5khzv\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.322838 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.322724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-5khzv\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.323177 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.323158    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-5khzv\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.323529 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.323513    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"]
Aug 04 12:36:05.327716 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.327701    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.337036 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.337005    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2vx\" (UniqueName: \"kubernetes.io/projected/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-kube-api-access-bg2vx\") pod \"kuadrant-operator-controller-manager-96db98c47-5khzv\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:05.349080 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.349054    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"]
Aug 04 12:36:05.423998 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.423904    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zsw\" (UniqueName: \"kubernetes.io/projected/f3d845e2-23ff-46a6-be56-75d0c1e343d0-kube-api-access-n9zsw\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.423998 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.423944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d845e2-23ff-46a6-be56-75d0c1e343d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.524713 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.524674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zsw\" (UniqueName: \"kubernetes.io/projected/f3d845e2-23ff-46a6-be56-75d0c1e343d0-kube-api-access-n9zsw\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.524713 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.524715    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d845e2-23ff-46a6-be56-75d0c1e343d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.525121 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.525101    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d845e2-23ff-46a6-be56-75d0c1e343d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.549271 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.549240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zsw\" (UniqueName: \"kubernetes.io/projected/f3d845e2-23ff-46a6-be56-75d0c1e343d0-kube-api-access-n9zsw\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.637285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.637240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.718574 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.718545    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"]
Aug 04 12:36:05.718785 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.718760    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" containerName="manager" containerID="cri-o://492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb" gracePeriod=2
Aug 04 12:36:05.725238 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.724904    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"]
Aug 04 12:36:05.737458 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.737420    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"]
Aug 04 12:36:05.742755 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.742730    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"]
Aug 04 12:36:05.757182 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.757147    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"]
Aug 04 12:36:05.757704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.757683    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" containerName="manager"
Aug 04 12:36:05.757704 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.757704    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" containerName="manager"
Aug 04 12:36:05.757903 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.757809    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" containerName="manager"
Aug 04 12:36:05.763797 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.763762    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"]
Aug 04 12:36:05.763926 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.763884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:05.770787 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.770758    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"]
Aug 04 12:36:05.776429 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.776350    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"]
Aug 04 12:36:05.776589 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.776522    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:05.777641 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.777619    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"]
Aug 04 12:36:05.791320 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.791286    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"]
Aug 04 12:36:05.791808 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.791779    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" containerName="manager" containerID="cri-o://f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b" gracePeriod=2
Aug 04 12:36:05.793926 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.793900    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"]
Aug 04 12:36:05.796527 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.796490    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:05.798989 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.798920    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"]
Aug 04 12:36:05.801308 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.799870    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:05.802744 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.802543    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:05.818618 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.818584    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"]
Aug 04 12:36:05.819005 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.818989    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" containerName="manager"
Aug 04 12:36:05.819005 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.819006    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" containerName="manager"
Aug 04 12:36:05.819214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.819078    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" containerName="manager"
Aug 04 12:36:05.822713 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.822689    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:05.831069 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.830536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7n2\" (UniqueName: \"kubernetes.io/projected/256899a0-57a3-451f-9081-6132ce24c4a6-kube-api-access-kt7n2\") pod \"kuadrant-operator-controller-manager-58fc56757c-lt7c4\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:05.831069 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.830587    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/256899a0-57a3-451f-9081-6132ce24c4a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-lt7c4\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:05.834099 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.833609    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:05.836022 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.835995    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"]
Aug 04 12:36:05.865211 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.865179    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:05.931428 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.931380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6rr\" (UniqueName: \"kubernetes.io/projected/0b34b296-bc3d-478e-8f63-00960795812d-kube-api-access-sg6rr\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bbrz6\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:05.931538 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.931508    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bpc\" (UniqueName: \"kubernetes.io/projected/f380e101-b725-41fb-ac28-0fbff76182f4-kube-api-access-74bpc\") pod \"limitador-operator-controller-manager-6c549b6d85-88ghd\" (UID: \"f380e101-b725-41fb-ac28-0fbff76182f4\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:05.931581 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.931542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b34b296-bc3d-478e-8f63-00960795812d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bbrz6\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:05.931627 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.931586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7n2\" (UniqueName: \"kubernetes.io/projected/256899a0-57a3-451f-9081-6132ce24c4a6-kube-api-access-kt7n2\") pod \"kuadrant-operator-controller-manager-58fc56757c-lt7c4\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:05.931666 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.931636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/256899a0-57a3-451f-9081-6132ce24c4a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-lt7c4\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:05.932036 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.932018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/256899a0-57a3-451f-9081-6132ce24c4a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-lt7c4\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:05.934456 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.934421    2574 log.go:32] "RunPodSandbox from runtime service failed" err=<
Aug 04 12:36:05.934456 ip-10-0-132-243 kubenswrapper[2574]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-bwdml_kuadrant-system_f3d845e2-23ff-46a6-be56-75d0c1e343d0_0(26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-bwdml to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c" Netns:"/var/run/netns/54c06dfd-f235-4540-b941-fca51466ce34" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-6bd956ccf-bwdml;K8S_POD_INFRA_CONTAINER_ID=26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c;K8S_POD_UID=f3d845e2-23ff-46a6-be56-75d0c1e343d0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml] networking: [kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml/f3d845e2-23ff-46a6-be56-75d0c1e343d0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml 26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:1d [10.133.0.29/23]
Aug 04 12:36:05.934456 ip-10-0-132-243 kubenswrapper[2574]:         '
Aug 04 12:36:05.934456 ip-10-0-132-243 kubenswrapper[2574]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Aug 04 12:36:05.934456 ip-10-0-132-243 kubenswrapper[2574]:  >
Aug 04 12:36:05.934664 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:05.934485    2574 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Aug 04 12:36:05.934664 ip-10-0-132-243 kubenswrapper[2574]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-bwdml_kuadrant-system_f3d845e2-23ff-46a6-be56-75d0c1e343d0_0(26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-bwdml to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c" Netns:"/var/run/netns/54c06dfd-f235-4540-b941-fca51466ce34" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-6bd956ccf-bwdml;K8S_POD_INFRA_CONTAINER_ID=26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c;K8S_POD_UID=f3d845e2-23ff-46a6-be56-75d0c1e343d0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml] networking: [kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml/f3d845e2-23ff-46a6-be56-75d0c1e343d0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml 26a525441a7a9c8ed34aa79a75f33d8cf82d838fe8e2e8bbf6c5bd4cfaf96d9c network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:1d [10.133.0.29/23]
Aug 04 12:36:05.934664 ip-10-0-132-243 kubenswrapper[2574]:         '
Aug 04 12:36:05.934664 ip-10-0-132-243 kubenswrapper[2574]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Aug 04 12:36:05.934664 ip-10-0-132-243 kubenswrapper[2574]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:05.945290 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:05.945209    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7n2\" (UniqueName: \"kubernetes.io/projected/256899a0-57a3-451f-9081-6132ce24c4a6-kube-api-access-kt7n2\") pod \"kuadrant-operator-controller-manager-58fc56757c-lt7c4\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:06.032833 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.032793    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6rr\" (UniqueName: \"kubernetes.io/projected/0b34b296-bc3d-478e-8f63-00960795812d-kube-api-access-sg6rr\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bbrz6\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:06.032973 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.032862    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bpc\" (UniqueName: \"kubernetes.io/projected/f380e101-b725-41fb-ac28-0fbff76182f4-kube-api-access-74bpc\") pod \"limitador-operator-controller-manager-6c549b6d85-88ghd\" (UID: \"f380e101-b725-41fb-ac28-0fbff76182f4\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:06.032973 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.032897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b34b296-bc3d-478e-8f63-00960795812d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bbrz6\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:06.033288 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.033270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b34b296-bc3d-478e-8f63-00960795812d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bbrz6\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:06.039118 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.039093    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.041832 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.041803    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.044595 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.044570    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.046864 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.046837    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.048754 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.048734    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bpc\" (UniqueName: \"kubernetes.io/projected/f380e101-b725-41fb-ac28-0fbff76182f4-kube-api-access-74bpc\") pod \"limitador-operator-controller-manager-6c549b6d85-88ghd\" (UID: \"f380e101-b725-41fb-ac28-0fbff76182f4\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:06.049284 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.049256    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.049705 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.049688    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6rr\" (UniqueName: \"kubernetes.io/projected/0b34b296-bc3d-478e-8f63-00960795812d-kube-api-access-sg6rr\") pod \"kuadrant-operator-controller-manager-6bd956ccf-bbrz6\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:06.051523 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.051500    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.079052 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.079014    2574 generic.go:356] "Generic (PLEG): container finished" podID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" containerID="f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b" exitCode=0
Aug 04 12:36:06.079200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.079064    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.079200 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.079108    2574 scope.go:117] "RemoveContainer" containerID="f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b"
Aug 04 12:36:06.080551 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.080527    2574 generic.go:356] "Generic (PLEG): container finished" podID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" containerID="492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb" exitCode=0
Aug 04 12:36:06.080667 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.080579    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.080719 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.080698    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:06.080719 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.080709    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:06.081693 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.081667    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.084157 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.084133    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.087664 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.087633    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.087899 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.087880    2574 scope.go:117] "RemoveContainer" containerID="f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b"
Aug 04 12:36:06.088177 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.088159    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b\": container with ID starting with f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b not found: ID does not exist" containerID="f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b"
Aug 04 12:36:06.088228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.088185    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b"} err="failed to get container status \"f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b\": rpc error: code = NotFound desc = could not find container \"f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b\": container with ID starting with f1f6d20456a6aad6d197569f3d3712b7d62f55d19f42886d3752576250dd3f1b not found: ID does not exist"
Aug 04 12:36:06.088228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.088216    2574 scope.go:117] "RemoveContainer" containerID="492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb"
Aug 04 12:36:06.089516 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.089460    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:06.089978 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.089937    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.092863 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.092845    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:06.095611 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.095585    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="f3d845e2-23ff-46a6-be56-75d0c1e343d0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:06.096562 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.096541    2574 scope.go:117] "RemoveContainer" containerID="492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb"
Aug 04 12:36:06.096853 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.096835    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb\": container with ID starting with 492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb not found: ID does not exist" containerID="492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb"
Aug 04 12:36:06.096910 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.096865    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb"} err="failed to get container status \"492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb\": rpc error: code = NotFound desc = could not find container \"492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb\": container with ID starting with 492fdd2539207f09e02d4dfda87b92e282781c2efe037e2e68ad3a3a2b805efb not found: ID does not exist"
Aug 04 12:36:06.097794 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.097771    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-5khzv\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:06.100299 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.100278    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-5khzv\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:06.102961 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.102938    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.105294 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.105273    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.107559 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.107539    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="f3d845e2-23ff-46a6-be56-75d0c1e343d0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:06.134091 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.134059    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8l77\" (UniqueName: \"kubernetes.io/projected/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-kube-api-access-j8l77\") pod \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") "
Aug 04 12:36:06.134562 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.134128    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qwhg\" (UniqueName: \"kubernetes.io/projected/d39f2b85-48b7-4d3c-8f93-37421e44ac9b-kube-api-access-4qwhg\") pod \"d39f2b85-48b7-4d3c-8f93-37421e44ac9b\" (UID: \"d39f2b85-48b7-4d3c-8f93-37421e44ac9b\") "
Aug 04 12:36:06.134562 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.134153    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-extensions-socket-volume\") pod \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\" (UID: \"9b6db092-4a12-4fc1-b8c5-01e7a90bbb99\") "
Aug 04 12:36:06.134709 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.134686    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" (UID: "9b6db092-4a12-4fc1-b8c5-01e7a90bbb99"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:36:06.136568 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.136538    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-kube-api-access-j8l77" (OuterVolumeSpecName: "kube-api-access-j8l77") pod "9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" (UID: "9b6db092-4a12-4fc1-b8c5-01e7a90bbb99"). InnerVolumeSpecName "kube-api-access-j8l77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:06.136648 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.136571    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d39f2b85-48b7-4d3c-8f93-37421e44ac9b-kube-api-access-4qwhg" (OuterVolumeSpecName: "kube-api-access-4qwhg") pod "d39f2b85-48b7-4d3c-8f93-37421e44ac9b" (UID: "d39f2b85-48b7-4d3c-8f93-37421e44ac9b"). InnerVolumeSpecName "kube-api-access-4qwhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:06.153764 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.153715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:06.163475 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.163445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:06.171694 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.171662    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237363    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9zsw\" (UniqueName: \"kubernetes.io/projected/f3d845e2-23ff-46a6-be56-75d0c1e343d0-kube-api-access-n9zsw\") pod \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") "
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237459    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg2vx\" (UniqueName: \"kubernetes.io/projected/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-kube-api-access-bg2vx\") pod \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") "
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237532    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-extensions-socket-volume\") pod \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\" (UID: \"5c3f4c2f-27d6-405f-924d-cdb1cf7a9643\") "
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237564    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d845e2-23ff-46a6-be56-75d0c1e343d0-extensions-socket-volume\") pod \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\" (UID: \"f3d845e2-23ff-46a6-be56-75d0c1e343d0\") "
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237799    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8l77\" (UniqueName: \"kubernetes.io/projected/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-kube-api-access-j8l77\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237817    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qwhg\" (UniqueName: \"kubernetes.io/projected/d39f2b85-48b7-4d3c-8f93-37421e44ac9b-kube-api-access-4qwhg\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.237832    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.239078    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" (UID: "5c3f4c2f-27d6-405f-924d-cdb1cf7a9643"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:36:06.239149 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.239101    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d845e2-23ff-46a6-be56-75d0c1e343d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3d845e2-23ff-46a6-be56-75d0c1e343d0" (UID: "f3d845e2-23ff-46a6-be56-75d0c1e343d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:36:06.242264 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.242213    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-kube-api-access-bg2vx" (OuterVolumeSpecName: "kube-api-access-bg2vx") pod "5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" (UID: "5c3f4c2f-27d6-405f-924d-cdb1cf7a9643"). InnerVolumeSpecName "kube-api-access-bg2vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:06.243013 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.242983    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d845e2-23ff-46a6-be56-75d0c1e343d0-kube-api-access-n9zsw" (OuterVolumeSpecName: "kube-api-access-n9zsw") pod "f3d845e2-23ff-46a6-be56-75d0c1e343d0" (UID: "f3d845e2-23ff-46a6-be56-75d0c1e343d0"). InnerVolumeSpecName "kube-api-access-n9zsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:06.330310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.330280    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"]
Aug 04 12:36:06.332245 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:36:06.332216    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256899a0_57a3_451f_9081_6132ce24c4a6.slice/crio-ddb2e1727744e36d53c36115ad4062ed69ae3eee40a1d97b6b809f403df79060 WatchSource:0}: Error finding container ddb2e1727744e36d53c36115ad4062ed69ae3eee40a1d97b6b809f403df79060: Status 404 returned error can't find the container with id ddb2e1727744e36d53c36115ad4062ed69ae3eee40a1d97b6b809f403df79060
Aug 04 12:36:06.338589 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.338567    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d845e2-23ff-46a6-be56-75d0c1e343d0-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.338589 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.338590    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9zsw\" (UniqueName: \"kubernetes.io/projected/f3d845e2-23ff-46a6-be56-75d0c1e343d0-kube-api-access-n9zsw\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.338717 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.338600    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg2vx\" (UniqueName: \"kubernetes.io/projected/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-kube-api-access-bg2vx\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.338717 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.338609    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:06.393940 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.393908    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.396766 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.396740    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="f3d845e2-23ff-46a6-be56-75d0c1e343d0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:06.398835 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.398814    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-5khzv\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:06.401266 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.401225    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.403471 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.403449    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7t22d\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7t22d"
Aug 04 12:36:06.405749 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.405725    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="f3d845e2-23ff-46a6-be56-75d0c1e343d0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:06.407851 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.407823    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-5khzv\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:06.410010 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:06.409990    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-sm4nf\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-sm4nf"
Aug 04 12:36:06.547057 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.546972    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"]
Aug 04 12:36:06.551344 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.551321    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"]
Aug 04 12:36:06.553459 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:36:06.553432    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf380e101_b725_41fb_ac28_0fbff76182f4.slice/crio-31f15b94ea1acf0c0000e857839c76ce8fc184624b9d2cde16ea9f8788f73e9f WatchSource:0}: Error finding container 31f15b94ea1acf0c0000e857839c76ce8fc184624b9d2cde16ea9f8788f73e9f: Status 404 returned error can't find the container with id 31f15b94ea1acf0c0000e857839c76ce8fc184624b9d2cde16ea9f8788f73e9f
Aug 04 12:36:06.554974 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:36:06.554950    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b34b296_bc3d_478e_8f63_00960795812d.slice/crio-fe4768e892dbeb56c8af4bfe368ba82eced52a95490ccefb75e47a13e420db78 WatchSource:0}: Error finding container fe4768e892dbeb56c8af4bfe368ba82eced52a95490ccefb75e47a13e420db78: Status 404 returned error can't find the container with id fe4768e892dbeb56c8af4bfe368ba82eced52a95490ccefb75e47a13e420db78
Aug 04 12:36:06.977544 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.977505    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" path="/var/lib/kubelet/pods/5c3f4c2f-27d6-405f-924d-cdb1cf7a9643/volumes"
Aug 04 12:36:06.977776 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.977763    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6db092-4a12-4fc1-b8c5-01e7a90bbb99" path="/var/lib/kubelet/pods/9b6db092-4a12-4fc1-b8c5-01e7a90bbb99/volumes"
Aug 04 12:36:06.978047 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.978035    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d39f2b85-48b7-4d3c-8f93-37421e44ac9b" path="/var/lib/kubelet/pods/d39f2b85-48b7-4d3c-8f93-37421e44ac9b/volumes"
Aug 04 12:36:06.978327 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:06.978316    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d845e2-23ff-46a6-be56-75d0c1e343d0" path="/var/lib/kubelet/pods/f3d845e2-23ff-46a6-be56-75d0c1e343d0/volumes"
Aug 04 12:36:07.087815 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.087775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd" event={"ID":"f380e101-b725-41fb-ac28-0fbff76182f4","Type":"ContainerStarted","Data":"2bda86bd443436ffc6e90f11b409bca470d88c172bcca9efaca75a8ff1ba0266"}
Aug 04 12:36:07.088006 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.087838    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd" event={"ID":"f380e101-b725-41fb-ac28-0fbff76182f4","Type":"ContainerStarted","Data":"31f15b94ea1acf0c0000e857839c76ce8fc184624b9d2cde16ea9f8788f73e9f"}
Aug 04 12:36:07.088006 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.087880    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:07.089469 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.089440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6" event={"ID":"0b34b296-bc3d-478e-8f63-00960795812d","Type":"ContainerStarted","Data":"4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c"}
Aug 04 12:36:07.089588 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.089499    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:07.089588 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.089524    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6" event={"ID":"0b34b296-bc3d-478e-8f63-00960795812d","Type":"ContainerStarted","Data":"fe4768e892dbeb56c8af4bfe368ba82eced52a95490ccefb75e47a13e420db78"}
Aug 04 12:36:07.091965 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.091940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4" event={"ID":"256899a0-57a3-451f-9081-6132ce24c4a6","Type":"ContainerStarted","Data":"5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22"}
Aug 04 12:36:07.092059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.091982    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4" event={"ID":"256899a0-57a3-451f-9081-6132ce24c4a6","Type":"ContainerStarted","Data":"ddb2e1727744e36d53c36115ad4062ed69ae3eee40a1d97b6b809f403df79060"}
Aug 04 12:36:07.092059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.092002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:07.092059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.092018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:07.092170 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.092008    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:07.111407 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.111345    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd" podStartSLOduration=2.111329404 podStartE2EDuration="2.111329404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:36:07.110516592 +0000 UTC m=+524.634391318" watchObservedRunningTime="2026-08-04 12:36:07.111329404 +0000 UTC m=+524.635204130"
Aug 04 12:36:07.112976 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:07.112949    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-5khzv\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="5c3f4c2f-27d6-405f-924d-cdb1cf7a9643" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-5khzv"
Aug 04 12:36:07.136761 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.136701    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4" podStartSLOduration=2.136675759 podStartE2EDuration="2.136675759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:36:07.134536446 +0000 UTC m=+524.658411189" watchObservedRunningTime="2026-08-04 12:36:07.136675759 +0000 UTC m=+524.660550488"
Aug 04 12:36:07.137195 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:07.136976    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-bwdml\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="f3d845e2-23ff-46a6-be56-75d0c1e343d0" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bwdml"
Aug 04 12:36:07.163968 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:07.163915    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6" podStartSLOduration=2.16389648 podStartE2EDuration="2.16389648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:36:07.163548644 +0000 UTC m=+524.687423376" watchObservedRunningTime="2026-08-04 12:36:07.16389648 +0000 UTC m=+524.687771207"
Aug 04 12:36:18.099902 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.099827    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:18.100348 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.099906    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:18.100348 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.100055    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-88ghd"
Aug 04 12:36:18.222025 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.221989    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"]
Aug 04 12:36:18.222285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.222223    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4" podUID="256899a0-57a3-451f-9081-6132ce24c4a6" containerName="manager" containerID="cri-o://5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22" gracePeriod=10
Aug 04 12:36:18.469636 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.469614    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:18.640053 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.640025    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/256899a0-57a3-451f-9081-6132ce24c4a6-extensions-socket-volume\") pod \"256899a0-57a3-451f-9081-6132ce24c4a6\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") "
Aug 04 12:36:18.640258 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.640108    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt7n2\" (UniqueName: \"kubernetes.io/projected/256899a0-57a3-451f-9081-6132ce24c4a6-kube-api-access-kt7n2\") pod \"256899a0-57a3-451f-9081-6132ce24c4a6\" (UID: \"256899a0-57a3-451f-9081-6132ce24c4a6\") "
Aug 04 12:36:18.640416 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.640376    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256899a0-57a3-451f-9081-6132ce24c4a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "256899a0-57a3-451f-9081-6132ce24c4a6" (UID: "256899a0-57a3-451f-9081-6132ce24c4a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:36:18.642146 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.642122    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256899a0-57a3-451f-9081-6132ce24c4a6-kube-api-access-kt7n2" (OuterVolumeSpecName: "kube-api-access-kt7n2") pod "256899a0-57a3-451f-9081-6132ce24c4a6" (UID: "256899a0-57a3-451f-9081-6132ce24c4a6"). InnerVolumeSpecName "kube-api-access-kt7n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:18.696890 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.696848    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"]
Aug 04 12:36:18.697278 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.697260    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256899a0-57a3-451f-9081-6132ce24c4a6" containerName="manager"
Aug 04 12:36:18.697361 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.697280    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="256899a0-57a3-451f-9081-6132ce24c4a6" containerName="manager"
Aug 04 12:36:18.697436 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.697378    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="256899a0-57a3-451f-9081-6132ce24c4a6" containerName="manager"
Aug 04 12:36:18.700357 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.700336    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:18.738295 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.738256    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"]
Aug 04 12:36:18.740889 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.740860    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt7n2\" (UniqueName: \"kubernetes.io/projected/256899a0-57a3-451f-9081-6132ce24c4a6-kube-api-access-kt7n2\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:18.741010 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.740891    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/256899a0-57a3-451f-9081-6132ce24c4a6-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:18.841598 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.841556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcqk7\" (UniqueName: \"kubernetes.io/projected/138542f4-dcec-4550-a111-0c4c251fa4bc-kube-api-access-kcqk7\") pod \"kuadrant-operator-controller-manager-68cf589589-brpcw\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:18.841598 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.841606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/138542f4-dcec-4550-a111-0c4c251fa4bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-brpcw\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:18.942862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.942769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcqk7\" (UniqueName: \"kubernetes.io/projected/138542f4-dcec-4550-a111-0c4c251fa4bc-kube-api-access-kcqk7\") pod \"kuadrant-operator-controller-manager-68cf589589-brpcw\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:18.942862 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.942833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/138542f4-dcec-4550-a111-0c4c251fa4bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-brpcw\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:18.943257 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.943239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/138542f4-dcec-4550-a111-0c4c251fa4bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-brpcw\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:18.959358 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:18.959332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcqk7\" (UniqueName: \"kubernetes.io/projected/138542f4-dcec-4550-a111-0c4c251fa4bc-kube-api-access-kcqk7\") pod \"kuadrant-operator-controller-manager-68cf589589-brpcw\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:19.010186 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.010148    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:19.147644 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.147611    2574 generic.go:356] "Generic (PLEG): container finished" podID="256899a0-57a3-451f-9081-6132ce24c4a6" containerID="5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22" exitCode=0
Aug 04 12:36:19.148086 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.147653    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4" event={"ID":"256899a0-57a3-451f-9081-6132ce24c4a6","Type":"ContainerDied","Data":"5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22"}
Aug 04 12:36:19.148086 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.147712    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4" event={"ID":"256899a0-57a3-451f-9081-6132ce24c4a6","Type":"ContainerDied","Data":"ddb2e1727744e36d53c36115ad4062ed69ae3eee40a1d97b6b809f403df79060"}
Aug 04 12:36:19.148086 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.147737    2574 scope.go:117] "RemoveContainer" containerID="5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22"
Aug 04 12:36:19.148086 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.147662    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"
Aug 04 12:36:19.152201 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.152074    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"]
Aug 04 12:36:19.155335 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:36:19.155316    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138542f4_dcec_4550_a111_0c4c251fa4bc.slice/crio-95c75a22b7afa2664671f999a2d18ca69cb6076fddd450364511e11c09e5a8da WatchSource:0}: Error finding container 95c75a22b7afa2664671f999a2d18ca69cb6076fddd450364511e11c09e5a8da: Status 404 returned error can't find the container with id 95c75a22b7afa2664671f999a2d18ca69cb6076fddd450364511e11c09e5a8da
Aug 04 12:36:19.157244 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.157224    2574 scope.go:117] "RemoveContainer" containerID="5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22"
Aug 04 12:36:19.157556 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:19.157539    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22\": container with ID starting with 5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22 not found: ID does not exist" containerID="5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22"
Aug 04 12:36:19.157608 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.157564    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22"} err="failed to get container status \"5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22\": rpc error: code = NotFound desc = could not find container \"5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22\": container with ID starting with 5d12524b3a685f5c27f7c6e48a58c4ba1f5a9e6d89936d2487f33e41b64a7e22 not found: ID does not exist"
Aug 04 12:36:19.186318 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.186286    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"]
Aug 04 12:36:19.201840 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:19.201818    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lt7c4"]
Aug 04 12:36:20.153890 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:20.153858    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw" event={"ID":"138542f4-dcec-4550-a111-0c4c251fa4bc","Type":"ContainerStarted","Data":"ec6262af883eaaa94d9d608210833f7648042d0945fa87feca504a22b089906b"}
Aug 04 12:36:20.154314 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:20.153909    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw" event={"ID":"138542f4-dcec-4550-a111-0c4c251fa4bc","Type":"ContainerStarted","Data":"95c75a22b7afa2664671f999a2d18ca69cb6076fddd450364511e11c09e5a8da"}
Aug 04 12:36:20.154314 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:20.153967    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:20.211547 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:20.211493    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw" podStartSLOduration=2.211478419 podStartE2EDuration="2.211478419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:36:20.208978105 +0000 UTC m=+537.732852833" watchObservedRunningTime="2026-08-04 12:36:20.211478419 +0000 UTC m=+537.735353146"
Aug 04 12:36:20.972083 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:20.972053    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256899a0-57a3-451f-9081-6132ce24c4a6" path="/var/lib/kubelet/pods/256899a0-57a3-451f-9081-6132ce24c4a6/volumes"
Aug 04 12:36:31.162674 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.162644    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:36:31.254048 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.254004    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"]
Aug 04 12:36:31.254246 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.254224    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6" podUID="0b34b296-bc3d-478e-8f63-00960795812d" containerName="manager" containerID="cri-o://4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c" gracePeriod=10
Aug 04 12:36:31.508915 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.508890    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:31.538283 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.538226    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg6rr\" (UniqueName: \"kubernetes.io/projected/0b34b296-bc3d-478e-8f63-00960795812d-kube-api-access-sg6rr\") pod \"0b34b296-bc3d-478e-8f63-00960795812d\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") "
Aug 04 12:36:31.538283 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.538267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b34b296-bc3d-478e-8f63-00960795812d-extensions-socket-volume\") pod \"0b34b296-bc3d-478e-8f63-00960795812d\" (UID: \"0b34b296-bc3d-478e-8f63-00960795812d\") "
Aug 04 12:36:31.538764 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.538738    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b34b296-bc3d-478e-8f63-00960795812d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0b34b296-bc3d-478e-8f63-00960795812d" (UID: "0b34b296-bc3d-478e-8f63-00960795812d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:36:31.541045 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.541015    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b34b296-bc3d-478e-8f63-00960795812d-kube-api-access-sg6rr" (OuterVolumeSpecName: "kube-api-access-sg6rr") pod "0b34b296-bc3d-478e-8f63-00960795812d" (UID: "0b34b296-bc3d-478e-8f63-00960795812d"). InnerVolumeSpecName "kube-api-access-sg6rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:31.639801 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.639768    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg6rr\" (UniqueName: \"kubernetes.io/projected/0b34b296-bc3d-478e-8f63-00960795812d-kube-api-access-sg6rr\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:31.639801 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:31.639796    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b34b296-bc3d-478e-8f63-00960795812d-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:32.208186 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.208151    2574 generic.go:356] "Generic (PLEG): container finished" podID="0b34b296-bc3d-478e-8f63-00960795812d" containerID="4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c" exitCode=0
Aug 04 12:36:32.208677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.208196    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"
Aug 04 12:36:32.208677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.208241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6" event={"ID":"0b34b296-bc3d-478e-8f63-00960795812d","Type":"ContainerDied","Data":"4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c"}
Aug 04 12:36:32.208677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.208303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6" event={"ID":"0b34b296-bc3d-478e-8f63-00960795812d","Type":"ContainerDied","Data":"fe4768e892dbeb56c8af4bfe368ba82eced52a95490ccefb75e47a13e420db78"}
Aug 04 12:36:32.208677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.208338    2574 scope.go:117] "RemoveContainer" containerID="4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c"
Aug 04 12:36:32.217353 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.217335    2574 scope.go:117] "RemoveContainer" containerID="4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c"
Aug 04 12:36:32.217653 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:32.217636    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c\": container with ID starting with 4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c not found: ID does not exist" containerID="4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c"
Aug 04 12:36:32.217705 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.217664    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c"} err="failed to get container status \"4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c\": rpc error: code = NotFound desc = could not find container \"4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c\": container with ID starting with 4e9c40f6f0019dc3c4a7b60b66f2d09abeee8f3606e1bb982893b3e8cc38979c not found: ID does not exist"
Aug 04 12:36:32.241482 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.241453    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"]
Aug 04 12:36:32.253240 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.253216    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-bbrz6"]
Aug 04 12:36:32.972515 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:32.972475    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b34b296-bc3d-478e-8f63-00960795812d" path="/var/lib/kubelet/pods/0b34b296-bc3d-478e-8f63-00960795812d/volumes"
Aug 04 12:36:34.652856 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.652825    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"]
Aug 04 12:36:34.653329 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.653142    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b34b296-bc3d-478e-8f63-00960795812d" containerName="manager"
Aug 04 12:36:34.653329 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.653153    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b34b296-bc3d-478e-8f63-00960795812d" containerName="manager"
Aug 04 12:36:34.653329 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.653207    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b34b296-bc3d-478e-8f63-00960795812d" containerName="manager"
Aug 04 12:36:34.657504 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.657483    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.660309 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.660291    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rj6lq\""
Aug 04 12:36:34.665059 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665156 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665156 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99rtq\" (UniqueName: \"kubernetes.io/projected/afb269bc-1015-43cc-b3bd-043ddf07962e-kube-api-access-99rtq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665156 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665152    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665321 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665224    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665321 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665321 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665493 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afb269bc-1015-43cc-b3bd-043ddf07962e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.665493 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.665369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.670115 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.670086    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"]
Aug 04 12:36:34.766677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766635    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766677 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afb269bc-1015-43cc-b3bd-043ddf07962e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.766932 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.766910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99rtq\" (UniqueName: \"kubernetes.io/projected/afb269bc-1015-43cc-b3bd-043ddf07962e-kube-api-access-99rtq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.767245 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.767104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.767536 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.767495    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.767660 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.767576    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.767660 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.767619    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.767979 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.767949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afb269bc-1015-43cc-b3bd-043ddf07962e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.769483 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.769462    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.769731 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.769708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.777439 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.777367    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afb269bc-1015-43cc-b3bd-043ddf07962e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.777689 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.777667    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99rtq\" (UniqueName: \"kubernetes.io/projected/afb269bc-1015-43cc-b3bd-043ddf07962e-kube-api-access-99rtq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nfjzz\" (UID: \"afb269bc-1015-43cc-b3bd-043ddf07962e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:34.968721 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:34.968622    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:35.115593 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.115570    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"]
Aug 04 12:36:35.117421 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:36:35.117383    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb269bc_1015_43cc_b3bd_043ddf07962e.slice/crio-dca53b5b2a5e59de5e5a5a683904b043bf7e98695341e8db880b677f986c9a86 WatchSource:0}: Error finding container dca53b5b2a5e59de5e5a5a683904b043bf7e98695341e8db880b677f986c9a86: Status 404 returned error can't find the container with id dca53b5b2a5e59de5e5a5a683904b043bf7e98695341e8db880b677f986c9a86
Aug 04 12:36:35.119322 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.119289    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:36:35.119374 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.119362    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:36:35.119438 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.119421    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:36:35.229218 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.229130    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" event={"ID":"afb269bc-1015-43cc-b3bd-043ddf07962e","Type":"ContainerStarted","Data":"297b1c6e6cf0c4bf0d390dc0c18959a754da7b3d2127343f52c63a0aa47a0243"}
Aug 04 12:36:35.229218 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.229187    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" event={"ID":"afb269bc-1015-43cc-b3bd-043ddf07962e","Type":"ContainerStarted","Data":"dca53b5b2a5e59de5e5a5a683904b043bf7e98695341e8db880b677f986c9a86"}
Aug 04 12:36:35.253308 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.253226    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" podStartSLOduration=1.253207916 podStartE2EDuration="1.253207916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:36:35.251912757 +0000 UTC m=+552.775787483" watchObservedRunningTime="2026-08-04 12:36:35.253207916 +0000 UTC m=+552.777082643"
Aug 04 12:36:35.968999 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:35.968957    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:36.974405 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:36.974363    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:37.238550 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:37.238469    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:37.239544 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:37.239525    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:36:52.666113 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.666078    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-77znm"]
Aug 04 12:36:52.669462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.669445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:52.672330 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.672304    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kb44x\""
Aug 04 12:36:52.676930 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.676905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-77znm"]
Aug 04 12:36:52.726358 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.726323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469vz\" (UniqueName: \"kubernetes.io/projected/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e-kube-api-access-469vz\") pod \"authorino-b54df94b4-77znm\" (UID: \"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e\") " pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:52.827310 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.827271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469vz\" (UniqueName: \"kubernetes.io/projected/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e-kube-api-access-469vz\") pod \"authorino-b54df94b4-77znm\" (UID: \"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e\") " pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:52.839453 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.839415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-469vz\" (UniqueName: \"kubernetes.io/projected/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e-kube-api-access-469vz\") pod \"authorino-b54df94b4-77znm\" (UID: \"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e\") " pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:52.980282 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:52.980192    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:53.116600 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:53.116571    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-77znm"]
Aug 04 12:36:53.118968 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:36:53.118938    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c0d4bb3_1cd6_4a68_a781_bc1a9dae2e8e.slice/crio-dd73901becb897e39a42a28c00794bd71c77617554697957f049d6a006044ece WatchSource:0}: Error finding container dd73901becb897e39a42a28c00794bd71c77617554697957f049d6a006044ece: Status 404 returned error can't find the container with id dd73901becb897e39a42a28c00794bd71c77617554697957f049d6a006044ece
Aug 04 12:36:53.313509 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:53.313424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-77znm" event={"ID":"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e","Type":"ContainerStarted","Data":"dd73901becb897e39a42a28c00794bd71c77617554697957f049d6a006044ece"}
Aug 04 12:36:55.326342 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:55.326256    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-77znm" event={"ID":"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e","Type":"ContainerStarted","Data":"5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d"}
Aug 04 12:36:55.347282 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:55.347233    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-77znm" podStartSLOduration=1.416778466 podStartE2EDuration="3.34721657s" totalImagesPullingTime="1.930438104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:36:55.34649629 +0000 UTC m=+572.870371014" watchObservedRunningTime="2026-08-04 12:36:55.34721657 +0000 UTC m=+572.871091297"
Aug 04 12:36:56.281806 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:56.281767    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-77znm"]
Aug 04 12:36:57.335555 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:57.335513    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-77znm" podUID="3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" containerName="authorino" containerID="cri-o://5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d" gracePeriod=30
Aug 04 12:36:57.577070 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:57.577045    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:57.672962 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:57.672877    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-469vz\" (UniqueName: \"kubernetes.io/projected/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e-kube-api-access-469vz\") pod \"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e\" (UID: \"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e\") "
Aug 04 12:36:57.675117 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:57.675091    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e-kube-api-access-469vz" (OuterVolumeSpecName: "kube-api-access-469vz") pod "3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" (UID: "3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e"). InnerVolumeSpecName "kube-api-access-469vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:36:57.773538 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:57.773505    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-469vz\" (UniqueName: \"kubernetes.io/projected/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e-kube-api-access-469vz\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:36:58.340798 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.340759    2574 generic.go:356] "Generic (PLEG): container finished" podID="3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" containerID="5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d" exitCode=0
Aug 04 12:36:58.341203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.340812    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-77znm"
Aug 04 12:36:58.341203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.340834    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-77znm" event={"ID":"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e","Type":"ContainerDied","Data":"5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d"}
Aug 04 12:36:58.341203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.340868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-77znm" event={"ID":"3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e","Type":"ContainerDied","Data":"dd73901becb897e39a42a28c00794bd71c77617554697957f049d6a006044ece"}
Aug 04 12:36:58.341203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.340884    2574 scope.go:117] "RemoveContainer" containerID="5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d"
Aug 04 12:36:58.349479 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.349457    2574 scope.go:117] "RemoveContainer" containerID="5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d"
Aug 04 12:36:58.349774 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:36:58.349751    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d\": container with ID starting with 5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d not found: ID does not exist" containerID="5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d"
Aug 04 12:36:58.349869 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.349781    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d"} err="failed to get container status \"5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d\": rpc error: code = NotFound desc = could not find container \"5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d\": container with ID starting with 5ec03cc7e14ab5e92437ba4a76b674d83f0d063cbacca3d768dd17dac134160d not found: ID does not exist"
Aug 04 12:36:58.363362 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.363332    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-77znm"]
Aug 04 12:36:58.367713 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.367687    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-77znm"]
Aug 04 12:36:58.971478 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:36:58.971443    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" path="/var/lib/kubelet/pods/3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e/volumes"
Aug 04 12:37:13.181475 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.181436    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"]
Aug 04 12:37:13.181836 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.181799    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" containerName="authorino"
Aug 04 12:37:13.181836 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.181810    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" containerName="authorino"
Aug 04 12:37:13.181909 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.181868    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0d4bb3-1cd6-4a68-a781-bc1a9dae2e8e" containerName="authorino"
Aug 04 12:37:13.187906 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.187885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.190748 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.190717    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 12:37:13.190873 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.190785    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cskp8\""
Aug 04 12:37:13.190873 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.190722    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 12:37:13.190873 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.190858    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 12:37:13.193912 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.193887    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"]
Aug 04 12:37:13.309033 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.308999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k77vx\" (UniqueName: \"kubernetes.io/projected/a67db812-6263-4dda-a58e-715a4fc8b171-kube-api-access-k77vx\") pod \"postgres-69fb4594cf-tl7vj\" (UID: \"a67db812-6263-4dda-a58e-715a4fc8b171\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.309202 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.309049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a67db812-6263-4dda-a58e-715a4fc8b171-data\") pod \"postgres-69fb4594cf-tl7vj\" (UID: \"a67db812-6263-4dda-a58e-715a4fc8b171\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.409517 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.409486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77vx\" (UniqueName: \"kubernetes.io/projected/a67db812-6263-4dda-a58e-715a4fc8b171-kube-api-access-k77vx\") pod \"postgres-69fb4594cf-tl7vj\" (UID: \"a67db812-6263-4dda-a58e-715a4fc8b171\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.409517 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.409522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a67db812-6263-4dda-a58e-715a4fc8b171-data\") pod \"postgres-69fb4594cf-tl7vj\" (UID: \"a67db812-6263-4dda-a58e-715a4fc8b171\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.409860 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.409841    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a67db812-6263-4dda-a58e-715a4fc8b171-data\") pod \"postgres-69fb4594cf-tl7vj\" (UID: \"a67db812-6263-4dda-a58e-715a4fc8b171\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.421385 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.421359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k77vx\" (UniqueName: \"kubernetes.io/projected/a67db812-6263-4dda-a58e-715a4fc8b171-kube-api-access-k77vx\") pod \"postgres-69fb4594cf-tl7vj\" (UID: \"a67db812-6263-4dda-a58e-715a4fc8b171\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.498976 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.498887    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:13.631342 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:13.631319    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"]
Aug 04 12:37:13.633359 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:37:13.633326    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67db812_6263_4dda_a58e_715a4fc8b171.slice/crio-4964bd9a2eeaa5ba1351708eb974f40e289830ebb7a72ce8193d79f0633af672 WatchSource:0}: Error finding container 4964bd9a2eeaa5ba1351708eb974f40e289830ebb7a72ce8193d79f0633af672: Status 404 returned error can't find the container with id 4964bd9a2eeaa5ba1351708eb974f40e289830ebb7a72ce8193d79f0633af672
Aug 04 12:37:14.416256 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:14.416206    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj" event={"ID":"a67db812-6263-4dda-a58e-715a4fc8b171","Type":"ContainerStarted","Data":"4964bd9a2eeaa5ba1351708eb974f40e289830ebb7a72ce8193d79f0633af672"}
Aug 04 12:37:19.452197 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:19.452158    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj" event={"ID":"a67db812-6263-4dda-a58e-715a4fc8b171","Type":"ContainerStarted","Data":"9e6f4b8b4ff4e5375c3c1ab8bfd5a64d80130160ba069c9c8160082875820f87"}
Aug 04 12:37:19.452649 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:19.452230    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:19.472987 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:19.472930    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj" podStartSLOduration=1.673482549 podStartE2EDuration="6.472913292s" totalImagesPullingTime="4.799430743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:37:19.471019608 +0000 UTC m=+596.994894335" watchObservedRunningTime="2026-08-04 12:37:19.472913292 +0000 UTC m=+596.996788075"
Aug 04 12:37:22.926549 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:22.926522    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:37:22.929439 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:22.929417    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:37:25.486507 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:25.486472    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tl7vj"
Aug 04 12:37:26.070317 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.070280    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-54hn9"]
Aug 04 12:37:26.075039 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.075018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:26.081779 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.081748    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kb44x\""
Aug 04 12:37:26.087761 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.087734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-54hn9"]
Aug 04 12:37:26.110565 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.110528    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6pjb\" (UniqueName: \"kubernetes.io/projected/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a-kube-api-access-g6pjb\") pod \"authorino-5dc7ccb5f-54hn9\" (UID: \"a0cc2c9a-81a9-4018-9cda-7c5b22eed31a\") " pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:26.184518 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.184481    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-54hn9"]
Aug 04 12:37:26.184800 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:37:26.184773    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g6pjb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-54hn9" podUID="a0cc2c9a-81a9-4018-9cda-7c5b22eed31a"
Aug 04 12:37:26.211018 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.210980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6pjb\" (UniqueName: \"kubernetes.io/projected/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a-kube-api-access-g6pjb\") pod \"authorino-5dc7ccb5f-54hn9\" (UID: \"a0cc2c9a-81a9-4018-9cda-7c5b22eed31a\") " pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:26.221970 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.221939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6pjb\" (UniqueName: \"kubernetes.io/projected/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a-kube-api-access-g6pjb\") pod \"authorino-5dc7ccb5f-54hn9\" (UID: \"a0cc2c9a-81a9-4018-9cda-7c5b22eed31a\") " pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:26.484839 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.484808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:26.492045 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.492021    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:26.512933 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.512902    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6pjb\" (UniqueName: \"kubernetes.io/projected/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a-kube-api-access-g6pjb\") pod \"a0cc2c9a-81a9-4018-9cda-7c5b22eed31a\" (UID: \"a0cc2c9a-81a9-4018-9cda-7c5b22eed31a\") "
Aug 04 12:37:26.515067 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.515040    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a-kube-api-access-g6pjb" (OuterVolumeSpecName: "kube-api-access-g6pjb") pod "a0cc2c9a-81a9-4018-9cda-7c5b22eed31a" (UID: "a0cc2c9a-81a9-4018-9cda-7c5b22eed31a"). InnerVolumeSpecName "kube-api-access-g6pjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:37:26.613662 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:26.613623    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6pjb\" (UniqueName: \"kubernetes.io/projected/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a-kube-api-access-g6pjb\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:37:27.489354 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:27.489313    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-54hn9"
Aug 04 12:37:27.524511 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:27.524477    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-54hn9"]
Aug 04 12:37:27.527089 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:27.527063    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-54hn9"]
Aug 04 12:37:28.971979 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:37:28.971945    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0cc2c9a-81a9-4018-9cda-7c5b22eed31a" path="/var/lib/kubelet/pods/a0cc2c9a-81a9-4018-9cda-7c5b22eed31a/volumes"
Aug 04 12:38:10.270565 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.270527    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"]
Aug 04 12:38:10.274053 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.274033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.276672 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.276651    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 12:38:10.276885 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.276869    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sz2vr\""
Aug 04 12:38:10.287664 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.287639    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"]
Aug 04 12:38:10.298671 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.298639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sq7h\" (UniqueName: \"kubernetes.io/projected/5e3f26f2-46ed-449d-b7ff-5c9a05898e70-kube-api-access-6sq7h\") pod \"payload-pre-processing-687dbb6cf6-bnz59\" (UID: \"5e3f26f2-46ed-449d-b7ff-5c9a05898e70\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.298821 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.298691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e3f26f2-46ed-449d-b7ff-5c9a05898e70-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bnz59\" (UID: \"5e3f26f2-46ed-449d-b7ff-5c9a05898e70\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.399255 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.399211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sq7h\" (UniqueName: \"kubernetes.io/projected/5e3f26f2-46ed-449d-b7ff-5c9a05898e70-kube-api-access-6sq7h\") pod \"payload-pre-processing-687dbb6cf6-bnz59\" (UID: \"5e3f26f2-46ed-449d-b7ff-5c9a05898e70\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.399462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.399263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e3f26f2-46ed-449d-b7ff-5c9a05898e70-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bnz59\" (UID: \"5e3f26f2-46ed-449d-b7ff-5c9a05898e70\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.399989 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.399967    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e3f26f2-46ed-449d-b7ff-5c9a05898e70-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bnz59\" (UID: \"5e3f26f2-46ed-449d-b7ff-5c9a05898e70\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.419832 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.419799    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sq7h\" (UniqueName: \"kubernetes.io/projected/5e3f26f2-46ed-449d-b7ff-5c9a05898e70-kube-api-access-6sq7h\") pod \"payload-pre-processing-687dbb6cf6-bnz59\" (UID: \"5e3f26f2-46ed-449d-b7ff-5c9a05898e70\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.584424 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.584307    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:10.724603 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:10.724573    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"]
Aug 04 12:38:10.728206 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:38:10.728177    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3f26f2_46ed_449d_b7ff_5c9a05898e70.slice/crio-f2dd6b3412fcf51420e4a35803fedcae4a97f2fc3b09a3c2acc8e45fdaea13a6 WatchSource:0}: Error finding container f2dd6b3412fcf51420e4a35803fedcae4a97f2fc3b09a3c2acc8e45fdaea13a6: Status 404 returned error can't find the container with id f2dd6b3412fcf51420e4a35803fedcae4a97f2fc3b09a3c2acc8e45fdaea13a6
Aug 04 12:38:11.699633 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:11.699586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59" event={"ID":"5e3f26f2-46ed-449d-b7ff-5c9a05898e70","Type":"ContainerStarted","Data":"f2dd6b3412fcf51420e4a35803fedcae4a97f2fc3b09a3c2acc8e45fdaea13a6"}
Aug 04 12:38:13.710966 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:13.710927    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59" event={"ID":"5e3f26f2-46ed-449d-b7ff-5c9a05898e70","Type":"ContainerStarted","Data":"14033e60132a2c702f8e4d49345d809da05bec0e5224d12c5e2f19c2a4434f07"}
Aug 04 12:38:13.711459 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:13.711112    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:13.736613 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:13.736557    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59" podStartSLOduration=1.846629696 podStartE2EDuration="3.736536658s" totalImagesPullingTime="1.889906962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:38:13.734711035 +0000 UTC m=+651.258585762" watchObservedRunningTime="2026-08-04 12:38:13.736536658 +0000 UTC m=+651.260411387"
Aug 04 12:38:19.746888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:19.746849    2574 generic.go:356] "Generic (PLEG): container finished" podID="afb269bc-1015-43cc-b3bd-043ddf07962e" containerID="297b1c6e6cf0c4bf0d390dc0c18959a754da7b3d2127343f52c63a0aa47a0243" exitCode=0
Aug 04 12:38:19.747299 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:19.746921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" event={"ID":"afb269bc-1015-43cc-b3bd-043ddf07962e","Type":"ContainerDied","Data":"297b1c6e6cf0c4bf0d390dc0c18959a754da7b3d2127343f52c63a0aa47a0243"}
Aug 04 12:38:19.747342 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:19.747298    2574 scope.go:117] "RemoveContainer" containerID="297b1c6e6cf0c4bf0d390dc0c18959a754da7b3d2127343f52c63a0aa47a0243"
Aug 04 12:38:19.748214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:19.748188    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:38:19.748268 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:19.748251    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:38:19.748302 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:19.748285    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:38:20.756329 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:20.756288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" event={"ID":"afb269bc-1015-43cc-b3bd-043ddf07962e","Type":"ContainerStarted","Data":"6704f6f8219fd811ad3afb06193a25ee17e6f8bee295f1e3995c4a87dbdbc3ad"}
Aug 04 12:38:20.970219 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:20.970184    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nfjzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Aug 04 12:38:20.970408 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:20.970240    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" podUID="afb269bc-1015-43cc-b3bd-043ddf07962e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Aug 04 12:38:20.972476 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:20.972454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:38:21.969035 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:21.969001    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nfjzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Aug 04 12:38:21.969438 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:21.969055    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" podUID="afb269bc-1015-43cc-b3bd-043ddf07962e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Aug 04 12:38:22.238746 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:22.238659    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:38:22.969292 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:22.969251    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nfjzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Aug 04 12:38:22.969792 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:22.969322    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" podUID="afb269bc-1015-43cc-b3bd-043ddf07962e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Aug 04 12:38:23.969192 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:23.969156    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nfjzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Aug 04 12:38:23.969369 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:23.969225    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" podUID="afb269bc-1015-43cc-b3bd-043ddf07962e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Aug 04 12:38:24.717840 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:24.717813    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bnz59"
Aug 04 12:38:24.969101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:24.969019    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nfjzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Aug 04 12:38:24.969101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:24.969087    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz" podUID="afb269bc-1015-43cc-b3bd-043ddf07962e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Aug 04 12:38:26.239854 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:26.239818    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:38:26.241495 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:38:26.241457    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nfjzz"
Aug 04 12:39:05.578179 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.578149    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"]
Aug 04 12:39:05.582292 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.582271    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.585447 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.585423    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 12:39:05.587264 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.587239    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mddbc\""
Aug 04 12:39:05.587426 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.587373    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 04 12:39:05.587585 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.587564    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 12:39:05.593551 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.593526    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"]
Aug 04 12:39:05.680357 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.680326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.680546 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.680367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb2jw\" (UniqueName: \"kubernetes.io/projected/6e509945-fa27-474f-9498-43fd28ea5d63-kube-api-access-hb2jw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.680546 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.680408    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.680546 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.680424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.680546 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.680441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.680546 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.680455    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e509945-fa27-474f-9498-43fd28ea5d63-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781055 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781242 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781069    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb2jw\" (UniqueName: \"kubernetes.io/projected/6e509945-fa27-474f-9498-43fd28ea5d63-kube-api-access-hb2jw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781242 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781242 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781242 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781128    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781242 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e509945-fa27-474f-9498-43fd28ea5d63-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781535 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781606 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781585    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.781664 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.781645    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.783567 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.783545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e509945-fa27-474f-9498-43fd28ea5d63-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.783724 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.783708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e509945-fa27-474f-9498-43fd28ea5d63-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.791228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.791198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb2jw\" (UniqueName: \"kubernetes.io/projected/6e509945-fa27-474f-9498-43fd28ea5d63-kube-api-access-hb2jw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hsh4s\" (UID: \"6e509945-fa27-474f-9498-43fd28ea5d63\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:05.894950 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:05.894918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:06.030592 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:06.030566    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"]
Aug 04 12:39:06.032192 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:39:06.032166    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e509945_fa27_474f_9498_43fd28ea5d63.slice/crio-d2f193723bb1c3d7234a0f9f2e0ffb92305470dbfe949d09d2df0da1390b7226 WatchSource:0}: Error finding container d2f193723bb1c3d7234a0f9f2e0ffb92305470dbfe949d09d2df0da1390b7226: Status 404 returned error can't find the container with id d2f193723bb1c3d7234a0f9f2e0ffb92305470dbfe949d09d2df0da1390b7226
Aug 04 12:39:06.033494 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:06.033478    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 12:39:06.973507 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:06.973462    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s" event={"ID":"6e509945-fa27-474f-9498-43fd28ea5d63","Type":"ContainerStarted","Data":"d2f193723bb1c3d7234a0f9f2e0ffb92305470dbfe949d09d2df0da1390b7226"}
Aug 04 12:39:07.977421 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:07.977372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s" event={"ID":"6e509945-fa27-474f-9498-43fd28ea5d63","Type":"ContainerStarted","Data":"70a2cfb14e61d2829aa85abd1ac589acee228674e7e932c021994f595f568444"}
Aug 04 12:39:07.997421 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:07.997351    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s" podStartSLOduration=1.9752826890000001 podStartE2EDuration="2.99733605s" totalImagesPullingTime="1.022053361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:39:07.995017092 +0000 UTC m=+705.518891818" watchObservedRunningTime="2026-08-04 12:39:07.99733605 +0000 UTC m=+705.521210777"
Aug 04 12:39:15.895570 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:15.895490    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:15.895937 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:15.895573    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:15.907988 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:15.907964    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:16.031017 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:16.030992    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hsh4s"
Aug 04 12:39:21.489722 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.489692    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"]
Aug 04 12:39:21.493203 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.493182    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.496195 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.496175    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 04 12:39:21.504708 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.504688    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"]
Aug 04 12:39:21.619284 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.619253    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttd9p\" (UniqueName: \"kubernetes.io/projected/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-kube-api-access-ttd9p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.619461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.619290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.619461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.619362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.619461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.619380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.619461 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.619437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.619601 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.619490    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720224 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttd9p\" (UniqueName: \"kubernetes.io/projected/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-kube-api-access-ttd9p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720788 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720901 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720765    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.720901 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.720804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.722748 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.722727    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.723035 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.723015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.730547 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.730525    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttd9p\" (UniqueName: \"kubernetes.io/projected/67e32736-9f39-4d91-98c3-d29aaf3f4fc4-kube-api-access-ttd9p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zg6xc\" (UID: \"67e32736-9f39-4d91-98c3-d29aaf3f4fc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.803607 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.803526    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:21.937687 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:21.937658    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"]
Aug 04 12:39:21.939135 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:39:21.939106    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e32736_9f39_4d91_98c3_d29aaf3f4fc4.slice/crio-1d93a7cd4e3708c6a57e4fad9f3856c67df0162b4f721c5ceb73127c146ab7c8 WatchSource:0}: Error finding container 1d93a7cd4e3708c6a57e4fad9f3856c67df0162b4f721c5ceb73127c146ab7c8: Status 404 returned error can't find the container with id 1d93a7cd4e3708c6a57e4fad9f3856c67df0162b4f721c5ceb73127c146ab7c8
Aug 04 12:39:22.060290 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:22.060204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc" event={"ID":"67e32736-9f39-4d91-98c3-d29aaf3f4fc4","Type":"ContainerStarted","Data":"1d93a7cd4e3708c6a57e4fad9f3856c67df0162b4f721c5ceb73127c146ab7c8"}
Aug 04 12:39:23.066580 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:23.066548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc" event={"ID":"67e32736-9f39-4d91-98c3-d29aaf3f4fc4","Type":"ContainerStarted","Data":"edf71186227616a088b3d022c309f4289f686ef0f9ee873afc746f512560e8bf"}
Aug 04 12:39:23.088940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:23.088890    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc" podStartSLOduration=1.750233216 podStartE2EDuration="2.088874497s" totalImagesPullingTime="338.641281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:39:23.087731682 +0000 UTC m=+720.611606415" watchObservedRunningTime="2026-08-04 12:39:23.088874497 +0000 UTC m=+720.612749222"
Aug 04 12:39:31.803662 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:31.803622    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:31.804084 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:31.803690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:31.816037 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:31.816015    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:32.120812 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:32.120783    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zg6xc"
Aug 04 12:39:38.304274 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.304245    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"]
Aug 04 12:39:38.307946 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.307927    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.311999 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.311974    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 04 12:39:38.318868 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.318846    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"]
Aug 04 12:39:38.463843 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.463805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.464097 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.463852    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.464097 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.463877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.464097 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.463998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z652j\" (UniqueName: \"kubernetes.io/projected/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-kube-api-access-z652j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.464097 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.464032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.464097 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.464069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.564984 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.564895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z652j\" (UniqueName: \"kubernetes.io/projected/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-kube-api-access-z652j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.564984 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.564940    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.564984 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.564973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.565238 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.565024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.565238 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.565057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.565238 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.565088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.565383 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.565359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.565463 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.565418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.565463 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.565434    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.567439 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.567413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.567787 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.567769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.573708 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.573689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z652j\" (UniqueName: \"kubernetes.io/projected/942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f-kube-api-access-z652j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk\" (UID: \"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.617346 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.617316    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:38.756193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:38.756168    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"]
Aug 04 12:39:38.758160 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:39:38.758127    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod942e2bf2_5ffa_4d24_98f5_4b75e1d6e02f.slice/crio-506bb2a74e3a7f773747f77c27a440378caeef0d0fbe63986508cd087c4a7bb8 WatchSource:0}: Error finding container 506bb2a74e3a7f773747f77c27a440378caeef0d0fbe63986508cd087c4a7bb8: Status 404 returned error can't find the container with id 506bb2a74e3a7f773747f77c27a440378caeef0d0fbe63986508cd087c4a7bb8
Aug 04 12:39:39.147962 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:39.147921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk" event={"ID":"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f","Type":"ContainerStarted","Data":"506bb2a74e3a7f773747f77c27a440378caeef0d0fbe63986508cd087c4a7bb8"}
Aug 04 12:39:40.155647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:40.155610    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk" event={"ID":"942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f","Type":"ContainerStarted","Data":"c5cbc1f8eb8e4f4b425a1300d42bb08b9e6c3290f0caee86f3da0bd792cb234e"}
Aug 04 12:39:40.174782 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:40.174730    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk" podStartSLOduration=1.690598413 podStartE2EDuration="2.174714401s" totalImagesPullingTime="484.115988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:39:40.173817614 +0000 UTC m=+737.697692342" watchObservedRunningTime="2026-08-04 12:39:40.174714401 +0000 UTC m=+737.698589127"
Aug 04 12:39:48.618154 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:48.618111    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:48.618586 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:48.618167    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:48.630658 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:48.630636    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:39:49.209792 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:39:49.209761    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk"
Aug 04 12:42:22.954261 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:42:22.954186    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:42:22.954261 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:42:22.954217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:47:22.980976 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:47:22.980949    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:47:22.982623 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:47:22.982600    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:49:34.803633 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:34.803595    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"]
Aug 04 12:49:34.806162 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:34.803813    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw" podUID="138542f4-dcec-4550-a111-0c4c251fa4bc" containerName="manager" containerID="cri-o://ec6262af883eaaa94d9d608210833f7648042d0945fa87feca504a22b089906b" gracePeriod=10
Aug 04 12:49:34.946209 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:34.946175    2574 generic.go:356] "Generic (PLEG): container finished" podID="138542f4-dcec-4550-a111-0c4c251fa4bc" containerID="ec6262af883eaaa94d9d608210833f7648042d0945fa87feca504a22b089906b" exitCode=0
Aug 04 12:49:34.946376 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:34.946255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw" event={"ID":"138542f4-dcec-4550-a111-0c4c251fa4bc","Type":"ContainerDied","Data":"ec6262af883eaaa94d9d608210833f7648042d0945fa87feca504a22b089906b"}
Aug 04 12:49:35.060050 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.059987    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:49:35.212894 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.212861    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcqk7\" (UniqueName: \"kubernetes.io/projected/138542f4-dcec-4550-a111-0c4c251fa4bc-kube-api-access-kcqk7\") pod \"138542f4-dcec-4550-a111-0c4c251fa4bc\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") "
Aug 04 12:49:35.212894 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.212899    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/138542f4-dcec-4550-a111-0c4c251fa4bc-extensions-socket-volume\") pod \"138542f4-dcec-4550-a111-0c4c251fa4bc\" (UID: \"138542f4-dcec-4550-a111-0c4c251fa4bc\") "
Aug 04 12:49:35.213309 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.213275    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/138542f4-dcec-4550-a111-0c4c251fa4bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "138542f4-dcec-4550-a111-0c4c251fa4bc" (UID: "138542f4-dcec-4550-a111-0c4c251fa4bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:49:35.215074 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.215049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138542f4-dcec-4550-a111-0c4c251fa4bc-kube-api-access-kcqk7" (OuterVolumeSpecName: "kube-api-access-kcqk7") pod "138542f4-dcec-4550-a111-0c4c251fa4bc" (UID: "138542f4-dcec-4550-a111-0c4c251fa4bc"). InnerVolumeSpecName "kube-api-access-kcqk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:49:35.313545 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.313441    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcqk7\" (UniqueName: \"kubernetes.io/projected/138542f4-dcec-4550-a111-0c4c251fa4bc-kube-api-access-kcqk7\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:49:35.313545 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.313487    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/138542f4-dcec-4550-a111-0c4c251fa4bc-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:49:35.952449 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.952382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw" event={"ID":"138542f4-dcec-4550-a111-0c4c251fa4bc","Type":"ContainerDied","Data":"95c75a22b7afa2664671f999a2d18ca69cb6076fddd450364511e11c09e5a8da"}
Aug 04 12:49:35.952449 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.952435    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"
Aug 04 12:49:35.952944 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.952504    2574 scope.go:117] "RemoveContainer" containerID="ec6262af883eaaa94d9d608210833f7648042d0945fa87feca504a22b089906b"
Aug 04 12:49:35.982008 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.981978    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"]
Aug 04 12:49:35.988094 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:35.988071    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-brpcw"]
Aug 04 12:49:36.971665 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:49:36.971635    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138542f4-dcec-4550-a111-0c4c251fa4bc" path="/var/lib/kubelet/pods/138542f4-dcec-4550-a111-0c4c251fa4bc/volumes"
Aug 04 12:50:35.561632 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.561601    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"]
Aug 04 12:50:35.562028 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.562014    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138542f4-dcec-4550-a111-0c4c251fa4bc" containerName="manager"
Aug 04 12:50:35.562071 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.562029    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="138542f4-dcec-4550-a111-0c4c251fa4bc" containerName="manager"
Aug 04 12:50:35.562107 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.562086    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="138542f4-dcec-4550-a111-0c4c251fa4bc" containerName="manager"
Aug 04 12:50:35.565306 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.565291    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.570857 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.570835    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vljjp\""
Aug 04 12:50:35.582729 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.582699    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"]
Aug 04 12:50:35.718741 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.718707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmr9r\" (UniqueName: \"kubernetes.io/projected/e4b61b70-b77b-4b3a-9090-f910868e0acf-kube-api-access-gmr9r\") pod \"kuadrant-operator-controller-manager-68cf589589-ck9qz\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.718929 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.718762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b61b70-b77b-4b3a-9090-f910868e0acf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ck9qz\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.820111 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.820004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmr9r\" (UniqueName: \"kubernetes.io/projected/e4b61b70-b77b-4b3a-9090-f910868e0acf-kube-api-access-gmr9r\") pod \"kuadrant-operator-controller-manager-68cf589589-ck9qz\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.820111 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.820066    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b61b70-b77b-4b3a-9090-f910868e0acf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ck9qz\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.820457 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.820440    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b61b70-b77b-4b3a-9090-f910868e0acf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ck9qz\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.836032 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.836001    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmr9r\" (UniqueName: \"kubernetes.io/projected/e4b61b70-b77b-4b3a-9090-f910868e0acf-kube-api-access-gmr9r\") pod \"kuadrant-operator-controller-manager-68cf589589-ck9qz\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:35.875109 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:35.875078    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:36.023744 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:36.023719    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"]
Aug 04 12:50:36.026770 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:50:36.026741    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b61b70_b77b_4b3a_9090_f910868e0acf.slice/crio-43ab7b03787948bf3a132abe0e7147a55ee5a6aba80e5d9a268555a1a6e94483 WatchSource:0}: Error finding container 43ab7b03787948bf3a132abe0e7147a55ee5a6aba80e5d9a268555a1a6e94483: Status 404 returned error can't find the container with id 43ab7b03787948bf3a132abe0e7147a55ee5a6aba80e5d9a268555a1a6e94483
Aug 04 12:50:36.229263 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:36.229226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz" event={"ID":"e4b61b70-b77b-4b3a-9090-f910868e0acf","Type":"ContainerStarted","Data":"4918b827de374b120b0f305bed40753b558d80a8ef32d79ff5ac88af3d973fb3"}
Aug 04 12:50:36.229475 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:36.229276    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz" event={"ID":"e4b61b70-b77b-4b3a-9090-f910868e0acf","Type":"ContainerStarted","Data":"43ab7b03787948bf3a132abe0e7147a55ee5a6aba80e5d9a268555a1a6e94483"}
Aug 04 12:50:36.229475 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:36.229317    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:50:36.283805 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:36.283754    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz" podStartSLOduration=1.283733495 podStartE2EDuration="1.283733495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:50:36.282314859 +0000 UTC m=+1393.806189592" watchObservedRunningTime="2026-08-04 12:50:36.283733495 +0000 UTC m=+1393.807608225"
Aug 04 12:50:47.236347 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:50:47.236317    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 12:52:23.011916 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:52:23.011881    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:52:23.015444 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:52:23.015425    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:53:57.179045 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.179014    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"]
Aug 04 12:53:57.182497 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.182471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.185070 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.185046    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-1940871b-kserve-self-signed-certs\""
Aug 04 12:53:57.199900 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.199870    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"]
Aug 04 12:53:57.268982 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.268940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-tmp-dir\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.269152 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.269035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-model-cache\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.269152 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.269070    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fede2b15-42ac-4789-910c-2a37aa90aef8-tls-certs\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.269152 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.269099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtv2\" (UniqueName: \"kubernetes.io/projected/fede2b15-42ac-4789-910c-2a37aa90aef8-kube-api-access-qqtv2\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.269152 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.269121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-dshm\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.269287 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.269200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-home\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.369911 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.369876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtv2\" (UniqueName: \"kubernetes.io/projected/fede2b15-42ac-4789-910c-2a37aa90aef8-kube-api-access-qqtv2\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.369911 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.369916    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-dshm\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.369938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-home\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.369972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-tmp-dir\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.370037    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-model-cache\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370163 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.370059    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fede2b15-42ac-4789-910c-2a37aa90aef8-tls-certs\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370374 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.370334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-home\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370520 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.370498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-tmp-dir\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.370590 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.370568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-model-cache\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.372334 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.372311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-dshm\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.372649 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.372632    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fede2b15-42ac-4789-910c-2a37aa90aef8-tls-certs\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.380718 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.380690    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtv2\" (UniqueName: \"kubernetes.io/projected/fede2b15-42ac-4789-910c-2a37aa90aef8-kube-api-access-qqtv2\") pod \"e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") " pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.492055 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.491954    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:53:57.629440 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:57.629411    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"]
Aug 04 12:53:57.631709 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:53:57.631677    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfede2b15_42ac_4789_910c_2a37aa90aef8.slice/crio-b3395a163a8349f077473abb1574f0dd51a4731e923e04825866887028eb416a WatchSource:0}: Error finding container b3395a163a8349f077473abb1574f0dd51a4731e923e04825866887028eb416a: Status 404 returned error can't find the container with id b3395a163a8349f077473abb1574f0dd51a4731e923e04825866887028eb416a
Aug 04 12:53:58.192311 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:58.192274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc" event={"ID":"fede2b15-42ac-4789-910c-2a37aa90aef8","Type":"ContainerStarted","Data":"f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144"}
Aug 04 12:53:58.192311 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:58.192317    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc" event={"ID":"fede2b15-42ac-4789-910c-2a37aa90aef8","Type":"ContainerStarted","Data":"b3395a163a8349f077473abb1574f0dd51a4731e923e04825866887028eb416a"}
Aug 04 12:53:58.211814 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:53:58.211767    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc" podStartSLOduration=1.211751571 podStartE2EDuration="1.211751571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:53:58.210681079 +0000 UTC m=+1595.734555797" watchObservedRunningTime="2026-08-04 12:53:58.211751571 +0000 UTC m=+1595.735626297"
Aug 04 12:54:07.492366 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:07.492329    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:54:07.492793 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:07.492384    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:54:07.504837 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:07.504810    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:54:08.261318 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:08.261284    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:54:41.374879 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:41.374847    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"]
Aug 04 12:54:56.394207 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.394132    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc" podUID="fede2b15-42ac-4789-910c-2a37aa90aef8" containerName="main" containerID="cri-o://f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144" gracePeriod=45
Aug 04 12:54:56.642327 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.642298    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:54:56.813142 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813052    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-dshm\") pod \"fede2b15-42ac-4789-910c-2a37aa90aef8\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") "
Aug 04 12:54:56.813142 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fede2b15-42ac-4789-910c-2a37aa90aef8-tls-certs\") pod \"fede2b15-42ac-4789-910c-2a37aa90aef8\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") "
Aug 04 12:54:56.813341 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813172    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-tmp-dir\") pod \"fede2b15-42ac-4789-910c-2a37aa90aef8\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") "
Aug 04 12:54:56.813341 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813195    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqtv2\" (UniqueName: \"kubernetes.io/projected/fede2b15-42ac-4789-910c-2a37aa90aef8-kube-api-access-qqtv2\") pod \"fede2b15-42ac-4789-910c-2a37aa90aef8\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") "
Aug 04 12:54:56.813475 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813442    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-home\") pod \"fede2b15-42ac-4789-910c-2a37aa90aef8\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") "
Aug 04 12:54:56.813532 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813517    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-model-cache\") pod \"fede2b15-42ac-4789-910c-2a37aa90aef8\" (UID: \"fede2b15-42ac-4789-910c-2a37aa90aef8\") "
Aug 04 12:54:56.813597 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813442    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fede2b15-42ac-4789-910c-2a37aa90aef8" (UID: "fede2b15-42ac-4789-910c-2a37aa90aef8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:54:56.813734 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813682    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-home" (OuterVolumeSpecName: "home") pod "fede2b15-42ac-4789-910c-2a37aa90aef8" (UID: "fede2b15-42ac-4789-910c-2a37aa90aef8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:54:56.814022 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813738    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-model-cache" (OuterVolumeSpecName: "model-cache") pod "fede2b15-42ac-4789-910c-2a37aa90aef8" (UID: "fede2b15-42ac-4789-910c-2a37aa90aef8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:54:56.814022 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813816    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:54:56.814022 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813832    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:54:56.814022 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.813848    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:54:56.815548 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.815524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-dshm" (OuterVolumeSpecName: "dshm") pod "fede2b15-42ac-4789-910c-2a37aa90aef8" (UID: "fede2b15-42ac-4789-910c-2a37aa90aef8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:54:56.815850 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.815832    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fede2b15-42ac-4789-910c-2a37aa90aef8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fede2b15-42ac-4789-910c-2a37aa90aef8" (UID: "fede2b15-42ac-4789-910c-2a37aa90aef8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 12:54:56.815902 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.815854    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fede2b15-42ac-4789-910c-2a37aa90aef8-kube-api-access-qqtv2" (OuterVolumeSpecName: "kube-api-access-qqtv2") pod "fede2b15-42ac-4789-910c-2a37aa90aef8" (UID: "fede2b15-42ac-4789-910c-2a37aa90aef8"). InnerVolumeSpecName "kube-api-access-qqtv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:54:56.914909 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.914873    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fede2b15-42ac-4789-910c-2a37aa90aef8-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:54:56.914909 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.914906    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fede2b15-42ac-4789-910c-2a37aa90aef8-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:54:56.914909 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:56.914916    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqtv2\" (UniqueName: \"kubernetes.io/projected/fede2b15-42ac-4789-910c-2a37aa90aef8-kube-api-access-qqtv2\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:54:57.496597 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.496562    2574 generic.go:356] "Generic (PLEG): container finished" podID="fede2b15-42ac-4789-910c-2a37aa90aef8" containerID="f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144" exitCode=0
Aug 04 12:54:57.497101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.496608    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"
Aug 04 12:54:57.497101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.496647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc" event={"ID":"fede2b15-42ac-4789-910c-2a37aa90aef8","Type":"ContainerDied","Data":"f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144"}
Aug 04 12:54:57.497101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.496694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc" event={"ID":"fede2b15-42ac-4789-910c-2a37aa90aef8","Type":"ContainerDied","Data":"b3395a163a8349f077473abb1574f0dd51a4731e923e04825866887028eb416a"}
Aug 04 12:54:57.497101 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.496718    2574 scope.go:117] "RemoveContainer" containerID="f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144"
Aug 04 12:54:57.507853 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.507822    2574 scope.go:117] "RemoveContainer" containerID="f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144"
Aug 04 12:54:57.508166 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:54:57.508141    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144\": container with ID starting with f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144 not found: ID does not exist" containerID="f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144"
Aug 04 12:54:57.508248 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.508177    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144"} err="failed to get container status \"f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144\": rpc error: code = NotFound desc = could not find container \"f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144\": container with ID starting with f5fd53e4b69b7b42f5e53255ebdd93286ec68f4e8ae7bb43aecd301a6cb59144 not found: ID does not exist"
Aug 04 12:54:57.520990 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.520966    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"]
Aug 04 12:54:57.524215 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:57.524192    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-1940871b-kserve-77d8d44559-45jwc"]
Aug 04 12:54:58.972722 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:54:58.972685    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fede2b15-42ac-4789-910c-2a37aa90aef8" path="/var/lib/kubelet/pods/fede2b15-42ac-4789-910c-2a37aa90aef8/volumes"
Aug 04 12:57:23.038462 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:57:23.038432    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:57:23.043330 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:57:23.043305    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 12:58:40.444893 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.444861    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"]
Aug 04 12:58:40.445348 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.445230    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fede2b15-42ac-4789-910c-2a37aa90aef8" containerName="main"
Aug 04 12:58:40.445348 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.445241    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fede2b15-42ac-4789-910c-2a37aa90aef8" containerName="main"
Aug 04 12:58:40.445348 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.445303    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fede2b15-42ac-4789-910c-2a37aa90aef8" containerName="main"
Aug 04 12:58:40.448319 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.448297    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.453188 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.453166    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a1756385-openshift-default-dockercfg-xv95s\""
Aug 04 12:58:40.476447 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.476410    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"]
Aug 04 12:58:40.517011 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.516976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-socket\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517011 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-data\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9685c\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-kube-api-access-9685c\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-envoy\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-credential-socket\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-certs\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517285 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-token\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517583 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-podinfo\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.517583 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.517446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istiod-ca-cert\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618495 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-data\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618495 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9685c\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-kube-api-access-9685c\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618753 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-envoy\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618753 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-credential-socket\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618753 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-certs\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618753 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618611    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-token\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.618753 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-podinfo\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619001 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-data\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619001 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618948    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istiod-ca-cert\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619103 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.618997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-socket\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619103 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.619012    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-certs\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619103 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.619068    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-credential-socket\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619516 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.619454    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-socket\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.619647 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.619625    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istiod-ca-cert\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.620943 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.620925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-envoy\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.621344 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.621323    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-podinfo\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.628331 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.628307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-token\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.628472 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.628352    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9685c\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-kube-api-access-9685c\") pod \"e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") " pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.759158 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.759063    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:40.908888 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.908863    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"]
Aug 04 12:58:40.910984 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:58:40.910961    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c18876_3ff3_43de_9b88_bfb0928e1cfe.slice/crio-e44fd7849ba60e52554adaec8d7b24cfb25509b1aa09482e863186d266dcfcc9 WatchSource:0}: Error finding container e44fd7849ba60e52554adaec8d7b24cfb25509b1aa09482e863186d266dcfcc9: Status 404 returned error can't find the container with id e44fd7849ba60e52554adaec8d7b24cfb25509b1aa09482e863186d266dcfcc9
Aug 04 12:58:40.913241 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.913199    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:58:40.913315 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.913291    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:58:40.913353 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:40.913340    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:58:41.568666 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:41.568627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" event={"ID":"19c18876-3ff3-43de-9b88-bfb0928e1cfe","Type":"ContainerStarted","Data":"e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"}
Aug 04 12:58:41.569108 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:41.568682    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" event={"ID":"19c18876-3ff3-43de-9b88-bfb0928e1cfe","Type":"ContainerStarted","Data":"e44fd7849ba60e52554adaec8d7b24cfb25509b1aa09482e863186d266dcfcc9"}
Aug 04 12:58:41.593017 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:41.592964    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podStartSLOduration=1.592947364 podStartE2EDuration="1.592947364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:58:41.591237995 +0000 UTC m=+1879.115112723" watchObservedRunningTime="2026-08-04 12:58:41.592947364 +0000 UTC m=+1879.116822091"
Aug 04 12:58:41.759610 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:41.759560    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:41.765048 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:41.765022    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:42.573930 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:42.573892    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:42.574940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:42.574924    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:57.575791 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.575750    2574 patch_prober.go:28] interesting pod/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 12:58:57.576232 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.575836    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 12:58:57.655079 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.655045    2574 generic.go:356] "Generic (PLEG): container finished" podID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerID="e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490" exitCode=0
Aug 04 12:58:57.655262 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.655123    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" event={"ID":"19c18876-3ff3-43de-9b88-bfb0928e1cfe","Type":"ContainerDied","Data":"e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"}
Aug 04 12:58:57.655614 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.655597    2574 scope.go:117] "RemoveContainer" containerID="e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"
Aug 04 12:58:57.656627 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.656600    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:58:57.656681 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.656670    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:58:57.656720 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:57.656707    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 12:58:58.663519 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:58.663485    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" event={"ID":"19c18876-3ff3-43de-9b88-bfb0928e1cfe","Type":"ContainerStarted","Data":"c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556"}
Aug 04 12:58:58.760159 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:58.760119    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:58:58.760539 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:58.760504    2574 patch_prober.go:28] interesting pod/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 12:58:58.760676 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:58.760556    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 12:58:59.759912 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:59.759869    2574 patch_prober.go:28] interesting pod/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 12:58:59.760312 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:58:59.759938    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 12:59:00.759484 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:00.759448    2574 patch_prober.go:28] interesting pod/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 12:59:00.759662 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:00.759509    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 12:59:01.760228 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:01.760178    2574 patch_prober.go:28] interesting pod/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 12:59:01.760699 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:01.760247    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 12:59:02.759843 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:02.759805    2574 patch_prober.go:28] interesting pod/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 12:59:02.760019 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:02.759873    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 12:59:03.765205 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:03.765166    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:59:03.765716 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:03.765563    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:59:03.766250 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:03.766227    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:59:25.184337 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:25.184302    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"]
Aug 04 12:59:25.184961 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:25.184635    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy" containerID="cri-o://c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556" gracePeriod=30
Aug 04 12:59:30.449384 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.449315    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:59:30.574023 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.573989    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9685c\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-kube-api-access-9685c\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574032    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-envoy\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574073    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-podinfo\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574092    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-credential-socket\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574110    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-token\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574132    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-socket\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574193 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574159    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-certs\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574488 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istiod-ca-cert\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574488 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574256    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-data\") pod \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\" (UID: \"19c18876-3ff3-43de-9b88-bfb0928e1cfe\") "
Aug 04 12:59:30.574599 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574541    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:59:30.574599 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574549    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:59:30.574759 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574737    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-credential-socket\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.574930 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574915    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-socket\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.575007 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574757    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:59:30.575007 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574859    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 12:59:30.575007 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.574937    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:59:30.576542 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.576508    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:59:30.576653 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.576614    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 12:59:30.576949 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.576926    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-kube-api-access-9685c" (OuterVolumeSpecName: "kube-api-access-9685c") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "kube-api-access-9685c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 12:59:30.576949 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.576937    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19c18876-3ff3-43de-9b88-bfb0928e1cfe" (UID: "19c18876-3ff3-43de-9b88-bfb0928e1cfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 12:59:30.675940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675898    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-data\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.675940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675935    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9685c\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-kube-api-access-9685c\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.675940 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675948    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-envoy\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.676179 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675959    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-podinfo\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.676179 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675970    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istio-token\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.676179 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675980    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c18876-3ff3-43de-9b88-bfb0928e1cfe-workload-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.676179 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.675990    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c18876-3ff3-43de-9b88-bfb0928e1cfe-istiod-ca-cert\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 12:59:30.834795 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.834702    2574 generic.go:356] "Generic (PLEG): container finished" podID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerID="c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556" exitCode=0
Aug 04 12:59:30.834795 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.834761    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"
Aug 04 12:59:30.834795 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.834781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" event={"ID":"19c18876-3ff3-43de-9b88-bfb0928e1cfe","Type":"ContainerDied","Data":"c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556"}
Aug 04 12:59:30.834996 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.834870    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz" event={"ID":"19c18876-3ff3-43de-9b88-bfb0928e1cfe","Type":"ContainerDied","Data":"e44fd7849ba60e52554adaec8d7b24cfb25509b1aa09482e863186d266dcfcc9"}
Aug 04 12:59:30.834996 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.834899    2574 scope.go:117] "RemoveContainer" containerID="c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556"
Aug 04 12:59:30.845361 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.845335    2574 scope.go:117] "RemoveContainer" containerID="e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"
Aug 04 12:59:30.853646 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.853629    2574 scope.go:117] "RemoveContainer" containerID="c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556"
Aug 04 12:59:30.853903 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:59:30.853884    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556\": container with ID starting with c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556 not found: ID does not exist" containerID="c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556"
Aug 04 12:59:30.853952 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.853911    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556"} err="failed to get container status \"c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556\": rpc error: code = NotFound desc = could not find container \"c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556\": container with ID starting with c4f220f1dce73e3802ea58426599f88767e32c5648d1e5aa6820716d3218d556 not found: ID does not exist"
Aug 04 12:59:30.853952 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.853929    2574 scope.go:117] "RemoveContainer" containerID="e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"
Aug 04 12:59:30.854153 ip-10-0-132-243 kubenswrapper[2574]: E0804 12:59:30.854133    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490\": container with ID starting with e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490 not found: ID does not exist" containerID="e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"
Aug 04 12:59:30.854214 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.854163    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490"} err="failed to get container status \"e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490\": rpc error: code = NotFound desc = could not find container \"e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490\": container with ID starting with e1c13de269d5c9fe28392f07daaa85559237ae37e7c83301c4d41d31daf14490 not found: ID does not exist"
Aug 04 12:59:30.859541 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.859519    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"]
Aug 04 12:59:30.863739 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.863718    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a1756385-openshift-default-69b8bf74d8-vh6dz"]
Aug 04 12:59:30.974255 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:30.974210    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" path="/var/lib/kubelet/pods/19c18876-3ff3-43de-9b88-bfb0928e1cfe/volumes"
Aug 04 12:59:33.274332 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274298    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"]
Aug 04 12:59:33.274752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274677    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy"
Aug 04 12:59:33.274752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274689    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy"
Aug 04 12:59:33.274752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274699    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy"
Aug 04 12:59:33.274752 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274704    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy"
Aug 04 12:59:33.274883 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274770    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy"
Aug 04 12:59:33.274883 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.274780    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c18876-3ff3-43de-9b88-bfb0928e1cfe" containerName="istio-proxy"
Aug 04 12:59:33.279092 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.279073    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.283238 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.283210    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-fbddc9ad\""
Aug 04 12:59:33.283357 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.283291    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-fbddc9ad-dockercfg-bpn7n\""
Aug 04 12:59:33.287972 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.287948    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"]
Aug 04 12:59:33.398747 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.398708    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd29k\" (UniqueName: \"kubernetes.io/projected/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-kube-api-access-xd29k\") pod \"payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.398956 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.398766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.499804 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.499770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd29k\" (UniqueName: \"kubernetes.io/projected/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-kube-api-access-xd29k\") pod \"payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.499956 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.499816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.500564 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.500546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.510132 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.510101    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd29k\" (UniqueName: \"kubernetes.io/projected/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-kube-api-access-xd29k\") pod \"payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.590844 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.590811    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.733172 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.733117    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"]
Aug 04 12:59:33.735110 ip-10-0-132-243 kubenswrapper[2574]: W0804 12:59:33.735078    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0f6d93_a65a_4eaf_80de_9d23e88c5f69.slice/crio-3f3856f76b8f214b2c86dbe48f8795be142033208b5b8f19cb264d197324509c WatchSource:0}: Error finding container 3f3856f76b8f214b2c86dbe48f8795be142033208b5b8f19cb264d197324509c: Status 404 returned error can't find the container with id 3f3856f76b8f214b2c86dbe48f8795be142033208b5b8f19cb264d197324509c
Aug 04 12:59:33.851983 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.851900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl" event={"ID":"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69","Type":"ContainerStarted","Data":"f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570"}
Aug 04 12:59:33.851983 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.851955    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl" event={"ID":"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69","Type":"ContainerStarted","Data":"3f3856f76b8f214b2c86dbe48f8795be142033208b5b8f19cb264d197324509c"}
Aug 04 12:59:33.852194 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.852023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 12:59:33.885196 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:33.885145    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl" podStartSLOduration=0.885128581 podStartE2EDuration="885.128581ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 12:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 12:59:33.883931362 +0000 UTC m=+1931.407806101" watchObservedRunningTime="2026-08-04 12:59:33.885128581 +0000 UTC m=+1931.409003307"
Aug 04 12:59:44.859062 ip-10-0-132-243 kubenswrapper[2574]: I0804 12:59:44.859033    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 13:00:03.369347 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.369312    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"]
Aug 04 13:00:03.369836 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.369574    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl" podUID="ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" containerName="payload-pre-processing" containerID="cri-o://f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570" gracePeriod=30
Aug 04 13:00:03.629191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.629132    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 13:00:03.665066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.665035    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd29k\" (UniqueName: \"kubernetes.io/projected/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-kube-api-access-xd29k\") pod \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") "
Aug 04 13:00:03.665066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.665072    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-plugins-config-volume\") pod \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\" (UID: \"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69\") "
Aug 04 13:00:03.665534 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.665500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" (UID: "ff0f6d93-a65a-4eaf-80de-9d23e88c5f69"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:00:03.667213 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.667183    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-kube-api-access-xd29k" (OuterVolumeSpecName: "kube-api-access-xd29k") pod "ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" (UID: "ff0f6d93-a65a-4eaf-80de-9d23e88c5f69"). InnerVolumeSpecName "kube-api-access-xd29k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:00:03.765970 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.765930    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd29k\" (UniqueName: \"kubernetes.io/projected/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-kube-api-access-xd29k\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:00:03.765970 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.765964    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:00:03.999724 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.999638    2574 generic.go:356] "Generic (PLEG): container finished" podID="ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" containerID="f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570" exitCode=0
Aug 04 13:00:03.999724 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.999685    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"
Aug 04 13:00:03.999898 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.999727    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl" event={"ID":"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69","Type":"ContainerDied","Data":"f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570"}
Aug 04 13:00:03.999898 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.999786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl" event={"ID":"ff0f6d93-a65a-4eaf-80de-9d23e88c5f69","Type":"ContainerDied","Data":"3f3856f76b8f214b2c86dbe48f8795be142033208b5b8f19cb264d197324509c"}
Aug 04 13:00:03.999898 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:03.999815    2574 scope.go:117] "RemoveContainer" containerID="f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570"
Aug 04 13:00:04.014251 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:04.014212    2574 scope.go:117] "RemoveContainer" containerID="f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570"
Aug 04 13:00:04.014665 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:00:04.014645    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570\": container with ID starting with f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570 not found: ID does not exist" containerID="f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570"
Aug 04 13:00:04.014731 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:04.014675    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570"} err="failed to get container status \"f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570\": rpc error: code = NotFound desc = could not find container \"f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570\": container with ID starting with f5dc4a6a33469cac116f9ebbe131acfd0aa8abbf3d4d73a34a91d6cb15e76570 not found: ID does not exist"
Aug 04 13:00:04.029195 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:04.029171    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"]
Aug 04 13:00:04.035870 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:04.035841    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-fbddc9ad-59ccc99f4d-r5rfl"]
Aug 04 13:00:04.972559 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:04.972516    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" path="/var/lib/kubelet/pods/ff0f6d93-a65a-4eaf-80de-9d23e88c5f69/volumes"
Aug 04 13:00:08.369226 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.369190    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"]
Aug 04 13:00:08.369628 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.369567    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" containerName="payload-pre-processing"
Aug 04 13:00:08.369628 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.369579    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" containerName="payload-pre-processing"
Aug 04 13:00:08.369705 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.369644    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0f6d93-a65a-4eaf-80de-9d23e88c5f69" containerName="payload-pre-processing"
Aug 04 13:00:08.374066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.374046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.376703 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.376687    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f143cf24-dockercfg-pbpmv\""
Aug 04 13:00:08.376822 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.376689    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f143cf24\""
Aug 04 13:00:08.382501 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.382473    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"]
Aug 04 13:00:08.400507 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.400472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kqfm\" (UniqueName: \"kubernetes.io/projected/6a4285af-d024-4e1d-aa80-25cf6840cec3-kube-api-access-4kqfm\") pod \"payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") " pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.400655 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.400613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a4285af-d024-4e1d-aa80-25cf6840cec3-plugins-config-volume\") pod \"payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") " pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.501041 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.501007    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a4285af-d024-4e1d-aa80-25cf6840cec3-plugins-config-volume\") pod \"payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") " pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.501223 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.501047    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kqfm\" (UniqueName: \"kubernetes.io/projected/6a4285af-d024-4e1d-aa80-25cf6840cec3-kube-api-access-4kqfm\") pod \"payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") " pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.501823 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.501794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a4285af-d024-4e1d-aa80-25cf6840cec3-plugins-config-volume\") pod \"payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") " pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.510223 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.510202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kqfm\" (UniqueName: \"kubernetes.io/projected/6a4285af-d024-4e1d-aa80-25cf6840cec3-kube-api-access-4kqfm\") pod \"payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") " pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.685937 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.685860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:08.821874 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:08.821853    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"]
Aug 04 13:00:08.823888 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:00:08.823863    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4285af_d024_4e1d_aa80_25cf6840cec3.slice/crio-5e142a812823dbad19f56e44122ba9abaca10cab407a21952494fd94530d8a4a WatchSource:0}: Error finding container 5e142a812823dbad19f56e44122ba9abaca10cab407a21952494fd94530d8a4a: Status 404 returned error can't find the container with id 5e142a812823dbad19f56e44122ba9abaca10cab407a21952494fd94530d8a4a
Aug 04 13:00:09.026049 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:09.025970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw" event={"ID":"6a4285af-d024-4e1d-aa80-25cf6840cec3","Type":"ContainerStarted","Data":"ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820"}
Aug 04 13:00:09.026049 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:09.026033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw" event={"ID":"6a4285af-d024-4e1d-aa80-25cf6840cec3","Type":"ContainerStarted","Data":"5e142a812823dbad19f56e44122ba9abaca10cab407a21952494fd94530d8a4a"}
Aug 04 13:00:09.026290 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:09.026153    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:09.045762 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:09.045578    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw" podStartSLOduration=1.045558915 podStartE2EDuration="1.045558915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:00:09.045430713 +0000 UTC m=+1966.569305440" watchObservedRunningTime="2026-08-04 13:00:09.045558915 +0000 UTC m=+1966.569433644"
Aug 04 13:00:20.032164 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:20.032087    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:38.501542 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.501503    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"]
Aug 04 13:00:38.502090 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.501726    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw" podUID="6a4285af-d024-4e1d-aa80-25cf6840cec3" containerName="payload-processing" containerID="cri-o://ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820" gracePeriod=30
Aug 04 13:00:38.759110 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.759043    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:38.876306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.876262    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kqfm\" (UniqueName: \"kubernetes.io/projected/6a4285af-d024-4e1d-aa80-25cf6840cec3-kube-api-access-4kqfm\") pod \"6a4285af-d024-4e1d-aa80-25cf6840cec3\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") "
Aug 04 13:00:38.876507 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.876419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a4285af-d024-4e1d-aa80-25cf6840cec3-plugins-config-volume\") pod \"6a4285af-d024-4e1d-aa80-25cf6840cec3\" (UID: \"6a4285af-d024-4e1d-aa80-25cf6840cec3\") "
Aug 04 13:00:38.876800 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.876776    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4285af-d024-4e1d-aa80-25cf6840cec3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a4285af-d024-4e1d-aa80-25cf6840cec3" (UID: "6a4285af-d024-4e1d-aa80-25cf6840cec3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:00:38.878653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.878628    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4285af-d024-4e1d-aa80-25cf6840cec3-kube-api-access-4kqfm" (OuterVolumeSpecName: "kube-api-access-4kqfm") pod "6a4285af-d024-4e1d-aa80-25cf6840cec3" (UID: "6a4285af-d024-4e1d-aa80-25cf6840cec3"). InnerVolumeSpecName "kube-api-access-4kqfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:00:38.977994 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.977961    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kqfm\" (UniqueName: \"kubernetes.io/projected/6a4285af-d024-4e1d-aa80-25cf6840cec3-kube-api-access-4kqfm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:00:38.977994 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:38.977988    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a4285af-d024-4e1d-aa80-25cf6840cec3-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:00:39.168707 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.168668    2574 generic.go:356] "Generic (PLEG): container finished" podID="6a4285af-d024-4e1d-aa80-25cf6840cec3" containerID="ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820" exitCode=0
Aug 04 13:00:39.168880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.168714    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"
Aug 04 13:00:39.168880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.168752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw" event={"ID":"6a4285af-d024-4e1d-aa80-25cf6840cec3","Type":"ContainerDied","Data":"ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820"}
Aug 04 13:00:39.168880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.168799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw" event={"ID":"6a4285af-d024-4e1d-aa80-25cf6840cec3","Type":"ContainerDied","Data":"5e142a812823dbad19f56e44122ba9abaca10cab407a21952494fd94530d8a4a"}
Aug 04 13:00:39.168880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.168824    2574 scope.go:117] "RemoveContainer" containerID="ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820"
Aug 04 13:00:39.178022 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.178001    2574 scope.go:117] "RemoveContainer" containerID="ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820"
Aug 04 13:00:39.178339 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:00:39.178316    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820\": container with ID starting with ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820 not found: ID does not exist" containerID="ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820"
Aug 04 13:00:39.178499 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.178367    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820"} err="failed to get container status \"ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820\": rpc error: code = NotFound desc = could not find container \"ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820\": container with ID starting with ab7b6c8ad42b6117e721621c1526e6038c6aab9e438f5d3c274fee6004ce0820 not found: ID does not exist"
Aug 04 13:00:39.187770 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.187742    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"]
Aug 04 13:00:39.194461 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:39.194427    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f143cf24-59b9854cf4-j7kvw"]
Aug 04 13:00:40.972078 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:40.972047    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a4285af-d024-4e1d-aa80-25cf6840cec3" path="/var/lib/kubelet/pods/6a4285af-d024-4e1d-aa80-25cf6840cec3/volumes"
Aug 04 13:00:44.671070 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.671034    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"]
Aug 04 13:00:44.671504 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.671434    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4285af-d024-4e1d-aa80-25cf6840cec3" containerName="payload-processing"
Aug 04 13:00:44.671504 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.671446    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4285af-d024-4e1d-aa80-25cf6840cec3" containerName="payload-processing"
Aug 04 13:00:44.671578 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.671506    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4285af-d024-4e1d-aa80-25cf6840cec3" containerName="payload-processing"
Aug 04 13:00:44.676178 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.676153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.677795 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.677764    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"]
Aug 04 13:00:44.678868 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.678849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-cb728584-dockercfg-4nnh7\""
Aug 04 13:00:44.679095 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.679081    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-cb728584\""
Aug 04 13:00:44.681426 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.681406    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.686482 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.686452    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"]
Aug 04 13:00:44.692740 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.692711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"]
Aug 04 13:00:44.840005 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.839972    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-plugins-config-volume\") pod \"payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") " pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.840187 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.840042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9d5h\" (UniqueName: \"kubernetes.io/projected/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-kube-api-access-m9d5h\") pod \"payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") " pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.840187 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.840106    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05d34d21-8497-4ae3-9a96-ca56342797dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.840187 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.840152    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngwz\" (UniqueName: \"kubernetes.io/projected/05d34d21-8497-4ae3-9a96-ca56342797dd-kube-api-access-2ngwz\") pod \"payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.940922 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.940818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-plugins-config-volume\") pod \"payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") " pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.940922 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.940915    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9d5h\" (UniqueName: \"kubernetes.io/projected/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-kube-api-access-m9d5h\") pod \"payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") " pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.941151 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.940947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05d34d21-8497-4ae3-9a96-ca56342797dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.941151 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.940968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngwz\" (UniqueName: \"kubernetes.io/projected/05d34d21-8497-4ae3-9a96-ca56342797dd-kube-api-access-2ngwz\") pod \"payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.941895 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.941870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-plugins-config-volume\") pod \"payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") " pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.942037 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.942019    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05d34d21-8497-4ae3-9a96-ca56342797dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.949532 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.949504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9d5h\" (UniqueName: \"kubernetes.io/projected/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-kube-api-access-m9d5h\") pod \"payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") " pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:44.949532 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.949522    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngwz\" (UniqueName: \"kubernetes.io/projected/05d34d21-8497-4ae3-9a96-ca56342797dd-kube-api-access-2ngwz\") pod \"payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.990549 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.990516    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:44.997680 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:44.997657    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:45.147900 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:45.147870    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"]
Aug 04 13:00:45.150546 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:00:45.150507    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d34d21_8497_4ae3_9a96_ca56342797dd.slice/crio-6bea5954ba45827af9e090fc036f9a380060f2804b4604bb95370368c3482c02 WatchSource:0}: Error finding container 6bea5954ba45827af9e090fc036f9a380060f2804b4604bb95370368c3482c02: Status 404 returned error can't find the container with id 6bea5954ba45827af9e090fc036f9a380060f2804b4604bb95370368c3482c02
Aug 04 13:00:45.177337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:45.177240    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"]
Aug 04 13:00:45.179545 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:00:45.179521    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d727b11_d7b9_4835_a15f_9bd7a90c63ca.slice/crio-49b832693446fcdc7da0b4f504cd7cfb16ef5888a31c95629d6f90fcc45fbb36 WatchSource:0}: Error finding container 49b832693446fcdc7da0b4f504cd7cfb16ef5888a31c95629d6f90fcc45fbb36: Status 404 returned error can't find the container with id 49b832693446fcdc7da0b4f504cd7cfb16ef5888a31c95629d6f90fcc45fbb36
Aug 04 13:00:45.200933 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:45.200900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d" event={"ID":"05d34d21-8497-4ae3-9a96-ca56342797dd","Type":"ContainerStarted","Data":"6bea5954ba45827af9e090fc036f9a380060f2804b4604bb95370368c3482c02"}
Aug 04 13:00:45.202289 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:45.202265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr" event={"ID":"9d727b11-d7b9-4835-a15f-9bd7a90c63ca","Type":"ContainerStarted","Data":"49b832693446fcdc7da0b4f504cd7cfb16ef5888a31c95629d6f90fcc45fbb36"}
Aug 04 13:00:46.209238 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:46.209198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d" event={"ID":"05d34d21-8497-4ae3-9a96-ca56342797dd","Type":"ContainerStarted","Data":"625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07"}
Aug 04 13:00:46.209728 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:46.209366    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:00:46.210742 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:46.210722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr" event={"ID":"9d727b11-d7b9-4835-a15f-9bd7a90c63ca","Type":"ContainerStarted","Data":"1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5"}
Aug 04 13:00:46.210830 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:46.210774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:46.229365 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:46.229312    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d" podStartSLOduration=2.229297489 podStartE2EDuration="2.229297489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:00:46.22721697 +0000 UTC m=+2003.751091702" watchObservedRunningTime="2026-08-04 13:00:46.229297489 +0000 UTC m=+2003.753172258"
Aug 04 13:00:46.250011 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:46.249951    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr" podStartSLOduration=2.249932105 podStartE2EDuration="2.249932105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:00:46.249101471 +0000 UTC m=+2003.772976199" watchObservedRunningTime="2026-08-04 13:00:46.249932105 +0000 UTC m=+2003.773806833"
Aug 04 13:00:57.218875 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:57.218840    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:00:57.219251 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:00:57.218908    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:01:14.651055 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:14.651007    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"]
Aug 04 13:01:14.651658 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:14.651303    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr" podUID="9d727b11-d7b9-4835-a15f-9bd7a90c63ca" containerName="payload-processing" containerID="cri-o://1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5" gracePeriod=30
Aug 04 13:01:14.656614 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:14.656359    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"]
Aug 04 13:01:14.656760 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:14.656625    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d" podUID="05d34d21-8497-4ae3-9a96-ca56342797dd" containerName="payload-pre-processing" containerID="cri-o://625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07" gracePeriod=30
Aug 04 13:01:14.908801 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:14.908738    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:01:14.948777 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:14.948747    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:01:15.006306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.006271    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05d34d21-8497-4ae3-9a96-ca56342797dd-plugins-config-volume\") pod \"05d34d21-8497-4ae3-9a96-ca56342797dd\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") "
Aug 04 13:01:15.006511 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.006332    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ngwz\" (UniqueName: \"kubernetes.io/projected/05d34d21-8497-4ae3-9a96-ca56342797dd-kube-api-access-2ngwz\") pod \"05d34d21-8497-4ae3-9a96-ca56342797dd\" (UID: \"05d34d21-8497-4ae3-9a96-ca56342797dd\") "
Aug 04 13:01:15.006511 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.006440    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-plugins-config-volume\") pod \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") "
Aug 04 13:01:15.006610 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.006527    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9d5h\" (UniqueName: \"kubernetes.io/projected/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-kube-api-access-m9d5h\") pod \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\" (UID: \"9d727b11-d7b9-4835-a15f-9bd7a90c63ca\") "
Aug 04 13:01:15.006788 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.006758    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05d34d21-8497-4ae3-9a96-ca56342797dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05d34d21-8497-4ae3-9a96-ca56342797dd" (UID: "05d34d21-8497-4ae3-9a96-ca56342797dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:01:15.007051 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.006799    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d727b11-d7b9-4835-a15f-9bd7a90c63ca" (UID: "9d727b11-d7b9-4835-a15f-9bd7a90c63ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:01:15.008722 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.008693    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-kube-api-access-m9d5h" (OuterVolumeSpecName: "kube-api-access-m9d5h") pod "9d727b11-d7b9-4835-a15f-9bd7a90c63ca" (UID: "9d727b11-d7b9-4835-a15f-9bd7a90c63ca"). InnerVolumeSpecName "kube-api-access-m9d5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:01:15.008811 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.008760    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d34d21-8497-4ae3-9a96-ca56342797dd-kube-api-access-2ngwz" (OuterVolumeSpecName: "kube-api-access-2ngwz") pod "05d34d21-8497-4ae3-9a96-ca56342797dd" (UID: "05d34d21-8497-4ae3-9a96-ca56342797dd"). InnerVolumeSpecName "kube-api-access-2ngwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:01:15.107715 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.107676    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ngwz\" (UniqueName: \"kubernetes.io/projected/05d34d21-8497-4ae3-9a96-ca56342797dd-kube-api-access-2ngwz\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:01:15.107715 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.107710    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:01:15.107715 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.107719    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9d5h\" (UniqueName: \"kubernetes.io/projected/9d727b11-d7b9-4835-a15f-9bd7a90c63ca-kube-api-access-m9d5h\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:01:15.107715 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.107728    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05d34d21-8497-4ae3-9a96-ca56342797dd-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:01:15.351437 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.351372    2574 generic.go:356] "Generic (PLEG): container finished" podID="05d34d21-8497-4ae3-9a96-ca56342797dd" containerID="625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07" exitCode=0
Aug 04 13:01:15.351642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.351458    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d" event={"ID":"05d34d21-8497-4ae3-9a96-ca56342797dd","Type":"ContainerDied","Data":"625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07"}
Aug 04 13:01:15.351642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.351477    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"
Aug 04 13:01:15.351642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.351513    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d" event={"ID":"05d34d21-8497-4ae3-9a96-ca56342797dd","Type":"ContainerDied","Data":"6bea5954ba45827af9e090fc036f9a380060f2804b4604bb95370368c3482c02"}
Aug 04 13:01:15.351642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.351545    2574 scope.go:117] "RemoveContainer" containerID="625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07"
Aug 04 13:01:15.352871 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.352849    2574 generic.go:356] "Generic (PLEG): container finished" podID="9d727b11-d7b9-4835-a15f-9bd7a90c63ca" containerID="1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5" exitCode=0
Aug 04 13:01:15.352954 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.352914    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"
Aug 04 13:01:15.352954 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.352932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr" event={"ID":"9d727b11-d7b9-4835-a15f-9bd7a90c63ca","Type":"ContainerDied","Data":"1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5"}
Aug 04 13:01:15.353067 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.352993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr" event={"ID":"9d727b11-d7b9-4835-a15f-9bd7a90c63ca","Type":"ContainerDied","Data":"49b832693446fcdc7da0b4f504cd7cfb16ef5888a31c95629d6f90fcc45fbb36"}
Aug 04 13:01:15.361171 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.361148    2574 scope.go:117] "RemoveContainer" containerID="625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07"
Aug 04 13:01:15.361485 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:01:15.361464    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07\": container with ID starting with 625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07 not found: ID does not exist" containerID="625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07"
Aug 04 13:01:15.361591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.361493    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07"} err="failed to get container status \"625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07\": rpc error: code = NotFound desc = could not find container \"625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07\": container with ID starting with 625e2ef3ed75601a96b00832ebfd103b4cea86253125aa6e38fe104d7fcdfe07 not found: ID does not exist"
Aug 04 13:01:15.361591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.361511    2574 scope.go:117] "RemoveContainer" containerID="1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5"
Aug 04 13:01:15.369894 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.369876    2574 scope.go:117] "RemoveContainer" containerID="1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5"
Aug 04 13:01:15.370182 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:01:15.370164    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5\": container with ID starting with 1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5 not found: ID does not exist" containerID="1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5"
Aug 04 13:01:15.370245 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.370194    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5"} err="failed to get container status \"1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5\": rpc error: code = NotFound desc = could not find container \"1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5\": container with ID starting with 1488de703ec38f3a0b2d4c4130db8d18ab6d64fb1fb7a8c923428b9d686d93b5 not found: ID does not exist"
Aug 04 13:01:15.377904 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.377878    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"]
Aug 04 13:01:15.382074 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.382049    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-cb728584-867bd8f998-t2lwr"]
Aug 04 13:01:15.398212 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.398168    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"]
Aug 04 13:01:15.407535 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:15.407510    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-cb728584-75b44c47cb-q5l7d"]
Aug 04 13:01:16.972109 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:16.972078    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d34d21-8497-4ae3-9a96-ca56342797dd" path="/var/lib/kubelet/pods/05d34d21-8497-4ae3-9a96-ca56342797dd/volumes"
Aug 04 13:01:16.972508 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:01:16.972442    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d727b11-d7b9-4835-a15f-9bd7a90c63ca" path="/var/lib/kubelet/pods/9d727b11-d7b9-4835-a15f-9bd7a90c63ca/volumes"
Aug 04 13:02:23.063563 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:02:23.063534    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:02:23.070130 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:02:23.070108    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:03:24.596846 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.596760    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"]
Aug 04 13:03:24.597350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.597120    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d727b11-d7b9-4835-a15f-9bd7a90c63ca" containerName="payload-processing"
Aug 04 13:03:24.597350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.597131    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d727b11-d7b9-4835-a15f-9bd7a90c63ca" containerName="payload-processing"
Aug 04 13:03:24.597350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.597144    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d34d21-8497-4ae3-9a96-ca56342797dd" containerName="payload-pre-processing"
Aug 04 13:03:24.597350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.597150    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d34d21-8497-4ae3-9a96-ca56342797dd" containerName="payload-pre-processing"
Aug 04 13:03:24.597350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.597224    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d727b11-d7b9-4835-a15f-9bd7a90c63ca" containerName="payload-processing"
Aug 04 13:03:24.597350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.597235    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d34d21-8497-4ae3-9a96-ca56342797dd" containerName="payload-pre-processing"
Aug 04 13:03:24.600339 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.600321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.605267 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.605248    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d8882e5d-dockercfg-nb6sk\""
Aug 04 13:03:24.607637 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.607618    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d8882e5d\""
Aug 04 13:03:24.630610 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.630584    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"]
Aug 04 13:03:24.734498 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.734444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vf5g\" (UniqueName: \"kubernetes.io/projected/c73f6080-9022-4cce-808f-5007af38ebca-kube-api-access-9vf5g\") pod \"payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.734682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.734607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73f6080-9022-4cce-808f-5007af38ebca-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.835788 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.835750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vf5g\" (UniqueName: \"kubernetes.io/projected/c73f6080-9022-4cce-808f-5007af38ebca-kube-api-access-9vf5g\") pod \"payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.835953 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.835832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73f6080-9022-4cce-808f-5007af38ebca-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.836516 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.836498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73f6080-9022-4cce-808f-5007af38ebca-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.851752 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.851683    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vf5g\" (UniqueName: \"kubernetes.io/projected/c73f6080-9022-4cce-808f-5007af38ebca-kube-api-access-9vf5g\") pod \"payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:24.910749 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:24.910718    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:25.061105 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:25.061069    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"]
Aug 04 13:03:25.063371 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:03:25.063331    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73f6080_9022_4cce_808f_5007af38ebca.slice/crio-07d638a4f8c23964691dedda24eb838aa7375a1892b0fca59d2a7cd78fbc84b0 WatchSource:0}: Error finding container 07d638a4f8c23964691dedda24eb838aa7375a1892b0fca59d2a7cd78fbc84b0: Status 404 returned error can't find the container with id 07d638a4f8c23964691dedda24eb838aa7375a1892b0fca59d2a7cd78fbc84b0
Aug 04 13:03:25.980325 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:25.980289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6" event={"ID":"c73f6080-9022-4cce-808f-5007af38ebca","Type":"ContainerStarted","Data":"34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446"}
Aug 04 13:03:25.980726 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:25.980339    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6" event={"ID":"c73f6080-9022-4cce-808f-5007af38ebca","Type":"ContainerStarted","Data":"07d638a4f8c23964691dedda24eb838aa7375a1892b0fca59d2a7cd78fbc84b0"}
Aug 04 13:03:25.980726 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:25.980421    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:03:25.999508 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:25.999313    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6" podStartSLOduration=1.99929267 podStartE2EDuration="1.99929267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:03:25.99847482 +0000 UTC m=+2163.522349544" watchObservedRunningTime="2026-08-04 13:03:25.99929267 +0000 UTC m=+2163.523167398"
Aug 04 13:03:36.987451 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:03:36.987413    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:04:11.568866 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.568830    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"]
Aug 04 13:04:11.571440 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.569042    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6" podUID="c73f6080-9022-4cce-808f-5007af38ebca" containerName="payload-pre-processing" containerID="cri-o://34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446" gracePeriod=30
Aug 04 13:04:11.830567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.830505    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:04:11.954653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.954620    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73f6080-9022-4cce-808f-5007af38ebca-plugins-config-volume\") pod \"c73f6080-9022-4cce-808f-5007af38ebca\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") "
Aug 04 13:04:11.954849 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.954689    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vf5g\" (UniqueName: \"kubernetes.io/projected/c73f6080-9022-4cce-808f-5007af38ebca-kube-api-access-9vf5g\") pod \"c73f6080-9022-4cce-808f-5007af38ebca\" (UID: \"c73f6080-9022-4cce-808f-5007af38ebca\") "
Aug 04 13:04:11.955031 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.955004    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c73f6080-9022-4cce-808f-5007af38ebca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c73f6080-9022-4cce-808f-5007af38ebca" (UID: "c73f6080-9022-4cce-808f-5007af38ebca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:04:11.956900 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:11.956876    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73f6080-9022-4cce-808f-5007af38ebca-kube-api-access-9vf5g" (OuterVolumeSpecName: "kube-api-access-9vf5g") pod "c73f6080-9022-4cce-808f-5007af38ebca" (UID: "c73f6080-9022-4cce-808f-5007af38ebca"). InnerVolumeSpecName "kube-api-access-9vf5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:04:12.055337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.055298    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vf5g\" (UniqueName: \"kubernetes.io/projected/c73f6080-9022-4cce-808f-5007af38ebca-kube-api-access-9vf5g\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:04:12.055337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.055327    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73f6080-9022-4cce-808f-5007af38ebca-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:04:12.198674 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.198638    2574 generic.go:356] "Generic (PLEG): container finished" podID="c73f6080-9022-4cce-808f-5007af38ebca" containerID="34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446" exitCode=0
Aug 04 13:04:12.198851 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.198689    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"
Aug 04 13:04:12.198851 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.198701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6" event={"ID":"c73f6080-9022-4cce-808f-5007af38ebca","Type":"ContainerDied","Data":"34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446"}
Aug 04 13:04:12.198851 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.198744    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6" event={"ID":"c73f6080-9022-4cce-808f-5007af38ebca","Type":"ContainerDied","Data":"07d638a4f8c23964691dedda24eb838aa7375a1892b0fca59d2a7cd78fbc84b0"}
Aug 04 13:04:12.198851 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.198767    2574 scope.go:117] "RemoveContainer" containerID="34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446"
Aug 04 13:04:12.208214 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.208193    2574 scope.go:117] "RemoveContainer" containerID="34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446"
Aug 04 13:04:12.208490 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:04:12.208469    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446\": container with ID starting with 34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446 not found: ID does not exist" containerID="34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446"
Aug 04 13:04:12.208580 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.208498    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446"} err="failed to get container status \"34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446\": rpc error: code = NotFound desc = could not find container \"34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446\": container with ID starting with 34a5a0d128eb89fdf419f2fcad034734ab5e4936d79805438cbd296eb5ac4446 not found: ID does not exist"
Aug 04 13:04:12.235933 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.235908    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"]
Aug 04 13:04:12.241050 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.241030    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8882e5d-7798f867dd-dmjr6"]
Aug 04 13:04:12.972781 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:04:12.972745    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73f6080-9022-4cce-808f-5007af38ebca" path="/var/lib/kubelet/pods/c73f6080-9022-4cce-808f-5007af38ebca/volumes"
Aug 04 13:05:02.252685 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.252590    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"]
Aug 04 13:05:02.253233 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.252849    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz" podUID="e4b61b70-b77b-4b3a-9090-f910868e0acf" containerName="manager" containerID="cri-o://4918b827de374b120b0f305bed40753b558d80a8ef32d79ff5ac88af3d973fb3" gracePeriod=10
Aug 04 13:05:02.437445 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.437409    2574 generic.go:356] "Generic (PLEG): container finished" podID="e4b61b70-b77b-4b3a-9090-f910868e0acf" containerID="4918b827de374b120b0f305bed40753b558d80a8ef32d79ff5ac88af3d973fb3" exitCode=0
Aug 04 13:05:02.437629 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.437460    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz" event={"ID":"e4b61b70-b77b-4b3a-9090-f910868e0acf","Type":"ContainerDied","Data":"4918b827de374b120b0f305bed40753b558d80a8ef32d79ff5ac88af3d973fb3"}
Aug 04 13:05:02.503827 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.503764    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 13:05:02.583611 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.583579    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmr9r\" (UniqueName: \"kubernetes.io/projected/e4b61b70-b77b-4b3a-9090-f910868e0acf-kube-api-access-gmr9r\") pod \"e4b61b70-b77b-4b3a-9090-f910868e0acf\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") "
Aug 04 13:05:02.583807 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.583719    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b61b70-b77b-4b3a-9090-f910868e0acf-extensions-socket-volume\") pod \"e4b61b70-b77b-4b3a-9090-f910868e0acf\" (UID: \"e4b61b70-b77b-4b3a-9090-f910868e0acf\") "
Aug 04 13:05:02.584071 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.584048    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b61b70-b77b-4b3a-9090-f910868e0acf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4b61b70-b77b-4b3a-9090-f910868e0acf" (UID: "e4b61b70-b77b-4b3a-9090-f910868e0acf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:05:02.585699 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.585679    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b61b70-b77b-4b3a-9090-f910868e0acf-kube-api-access-gmr9r" (OuterVolumeSpecName: "kube-api-access-gmr9r") pod "e4b61b70-b77b-4b3a-9090-f910868e0acf" (UID: "e4b61b70-b77b-4b3a-9090-f910868e0acf"). InnerVolumeSpecName "kube-api-access-gmr9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:05:02.685157 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.685123    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmr9r\" (UniqueName: \"kubernetes.io/projected/e4b61b70-b77b-4b3a-9090-f910868e0acf-kube-api-access-gmr9r\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:05:02.685157 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:02.685152    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b61b70-b77b-4b3a-9090-f910868e0acf-extensions-socket-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:05:03.442610 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:03.442581    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"
Aug 04 13:05:03.443014 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:03.442580    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz" event={"ID":"e4b61b70-b77b-4b3a-9090-f910868e0acf","Type":"ContainerDied","Data":"43ab7b03787948bf3a132abe0e7147a55ee5a6aba80e5d9a268555a1a6e94483"}
Aug 04 13:05:03.443014 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:03.442719    2574 scope.go:117] "RemoveContainer" containerID="4918b827de374b120b0f305bed40753b558d80a8ef32d79ff5ac88af3d973fb3"
Aug 04 13:05:03.465971 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:03.465947    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"]
Aug 04 13:05:03.469990 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:03.469960    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ck9qz"]
Aug 04 13:05:04.972418 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:05:04.972358    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4b61b70-b77b-4b3a-9090-f910868e0acf" path="/var/lib/kubelet/pods/e4b61b70-b77b-4b3a-9090-f910868e0acf/volumes"
Aug 04 13:06:17.907382 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907302    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"]
Aug 04 13:06:17.907882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907659    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73f6080-9022-4cce-808f-5007af38ebca" containerName="payload-pre-processing"
Aug 04 13:06:17.907882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907670    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73f6080-9022-4cce-808f-5007af38ebca" containerName="payload-pre-processing"
Aug 04 13:06:17.907882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907682    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b61b70-b77b-4b3a-9090-f910868e0acf" containerName="manager"
Aug 04 13:06:17.907882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907688    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b61b70-b77b-4b3a-9090-f910868e0acf" containerName="manager"
Aug 04 13:06:17.907882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907753    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73f6080-9022-4cce-808f-5007af38ebca" containerName="payload-pre-processing"
Aug 04 13:06:17.907882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.907761    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b61b70-b77b-4b3a-9090-f910868e0acf" containerName="manager"
Aug 04 13:06:17.910751 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.910734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:17.915296 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.915273    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vljjp\""
Aug 04 13:06:17.932533 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:17.932506    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"]
Aug 04 13:06:18.022606 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.022570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/637d172d-fc69-4eac-abd7-aedaa5dc2272-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mz6p2\" (UID: \"637d172d-fc69-4eac-abd7-aedaa5dc2272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.022769 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.022627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb56h\" (UniqueName: \"kubernetes.io/projected/637d172d-fc69-4eac-abd7-aedaa5dc2272-kube-api-access-bb56h\") pod \"kuadrant-operator-controller-manager-68cf589589-mz6p2\" (UID: \"637d172d-fc69-4eac-abd7-aedaa5dc2272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.123759 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.123723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/637d172d-fc69-4eac-abd7-aedaa5dc2272-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mz6p2\" (UID: \"637d172d-fc69-4eac-abd7-aedaa5dc2272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.123905 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.123785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb56h\" (UniqueName: \"kubernetes.io/projected/637d172d-fc69-4eac-abd7-aedaa5dc2272-kube-api-access-bb56h\") pod \"kuadrant-operator-controller-manager-68cf589589-mz6p2\" (UID: \"637d172d-fc69-4eac-abd7-aedaa5dc2272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.124120 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.124102    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/637d172d-fc69-4eac-abd7-aedaa5dc2272-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mz6p2\" (UID: \"637d172d-fc69-4eac-abd7-aedaa5dc2272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.133490 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.133466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb56h\" (UniqueName: \"kubernetes.io/projected/637d172d-fc69-4eac-abd7-aedaa5dc2272-kube-api-access-bb56h\") pod \"kuadrant-operator-controller-manager-68cf589589-mz6p2\" (UID: \"637d172d-fc69-4eac-abd7-aedaa5dc2272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.221056 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.220978    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.357988 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.357962    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"]
Aug 04 13:06:18.361002 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:06:18.360971    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637d172d_fc69_4eac_abd7_aedaa5dc2272.slice/crio-bfe9102af28d108f51fe456ce422f052c480cff4a7e26222219abf1691ee8790 WatchSource:0}: Error finding container bfe9102af28d108f51fe456ce422f052c480cff4a7e26222219abf1691ee8790: Status 404 returned error can't find the container with id bfe9102af28d108f51fe456ce422f052c480cff4a7e26222219abf1691ee8790
Aug 04 13:06:18.783341 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.783295    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2" event={"ID":"637d172d-fc69-4eac-abd7-aedaa5dc2272","Type":"ContainerStarted","Data":"827053218fac2ffaf1c8dd67a313b21ea0f474d4d97c3bc0f78717ed733f7f70"}
Aug 04 13:06:18.783341 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.783345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2" event={"ID":"637d172d-fc69-4eac-abd7-aedaa5dc2272","Type":"ContainerStarted","Data":"bfe9102af28d108f51fe456ce422f052c480cff4a7e26222219abf1691ee8790"}
Aug 04 13:06:18.783630 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.783436    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:18.817312 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:18.817257    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2" podStartSLOduration=1.81724386 podStartE2EDuration="1.81724386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:06:18.814460199 +0000 UTC m=+2336.338334922" watchObservedRunningTime="2026-08-04 13:06:18.81724386 +0000 UTC m=+2336.341118586"
Aug 04 13:06:29.790286 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:29.790255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mz6p2"
Aug 04 13:06:41.212437 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.212400    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"]
Aug 04 13:06:41.215999 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.215976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.219237 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.219214    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f758d543-dockercfg-j7jbl\""
Aug 04 13:06:41.219237 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.219225    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f758d543\""
Aug 04 13:06:41.227012 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.226989    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"]
Aug 04 13:06:41.333947 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.333916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpkrr\" (UniqueName: \"kubernetes.io/projected/3487cd42-c317-4eef-9f5f-5289d03b248d-kube-api-access-kpkrr\") pod \"payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.333947 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.333949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3487cd42-c317-4eef-9f5f-5289d03b248d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.435022 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.434985    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpkrr\" (UniqueName: \"kubernetes.io/projected/3487cd42-c317-4eef-9f5f-5289d03b248d-kube-api-access-kpkrr\") pod \"payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.435022 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.435022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3487cd42-c317-4eef-9f5f-5289d03b248d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.435699 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.435679    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3487cd42-c317-4eef-9f5f-5289d03b248d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.444631 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.444607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpkrr\" (UniqueName: \"kubernetes.io/projected/3487cd42-c317-4eef-9f5f-5289d03b248d-kube-api-access-kpkrr\") pod \"payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.527622 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.527540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.662698 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.662675    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"]
Aug 04 13:06:41.664830 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:06:41.664804    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3487cd42_c317_4eef_9f5f_5289d03b248d.slice/crio-3cd0dd2fb7d8a434b9f81ba4d7faf0c18d61f25e68bc871b4a9733f8fe4f51c9 WatchSource:0}: Error finding container 3cd0dd2fb7d8a434b9f81ba4d7faf0c18d61f25e68bc871b4a9733f8fe4f51c9: Status 404 returned error can't find the container with id 3cd0dd2fb7d8a434b9f81ba4d7faf0c18d61f25e68bc871b4a9733f8fe4f51c9
Aug 04 13:06:41.891752 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.891715    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4" event={"ID":"3487cd42-c317-4eef-9f5f-5289d03b248d","Type":"ContainerStarted","Data":"5f552e7c23ffa374143919f55707933bf27ec0e11909eea1fadb63d42a4f8c6c"}
Aug 04 13:06:41.891941 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.891781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4" event={"ID":"3487cd42-c317-4eef-9f5f-5289d03b248d","Type":"ContainerStarted","Data":"3cd0dd2fb7d8a434b9f81ba4d7faf0c18d61f25e68bc871b4a9733f8fe4f51c9"}
Aug 04 13:06:41.891941 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.891819    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:06:41.915350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:41.912522    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4" podStartSLOduration=0.91250082 podStartE2EDuration="912.50082ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:06:41.909653452 +0000 UTC m=+2359.433528181" watchObservedRunningTime="2026-08-04 13:06:41.91250082 +0000 UTC m=+2359.436375547"
Aug 04 13:06:52.898826 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:06:52.898794    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:07:23.097151 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:23.097125    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:07:23.100108 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:23.100075    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:07:25.494892 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.494852    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"]
Aug 04 13:07:25.498609 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.498584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.502538 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.502510    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f758d543\"/\"default-dockercfg-x2hxm\""
Aug 04 13:07:25.502673 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.502509    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f758d543\"/\"kube-root-ca.crt\""
Aug 04 13:07:25.502673 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.502590    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f758d543\"/\"openshift-service-ca.crt\""
Aug 04 13:07:25.502673 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.502553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f758d543\"/\"e2e-lifecycle-model-f758d543-kserve-self-signed-certs\""
Aug 04 13:07:25.510530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.510506    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"]
Aug 04 13:07:25.608490 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.608452    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-tmp-dir\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.608664 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.608552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-dshm\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.608664 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.608574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-model-cache\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.608664 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.608603    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-home\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.608664 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.608637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf95a4-bc10-49b2-890a-a6fce864cb77-tls-certs\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.608806 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.608669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q64xr\" (UniqueName: \"kubernetes.io/projected/80cf95a4-bc10-49b2-890a-a6fce864cb77-kube-api-access-q64xr\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.709792 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.709753    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-home\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.709792 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.709797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf95a4-bc10-49b2-890a-a6fce864cb77-tls-certs\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.709828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q64xr\" (UniqueName: \"kubernetes.io/projected/80cf95a4-bc10-49b2-890a-a6fce864cb77-kube-api-access-q64xr\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.709884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-tmp-dir\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.709969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-dshm\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.709991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-model-cache\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710280 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.710252    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-home\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710347 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.710326    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-tmp-dir\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.710498 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.710479    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-model-cache\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.712332 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.712311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-dshm\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.712465 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.712449    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf95a4-bc10-49b2-890a-a6fce864cb77-tls-certs\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.719356 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.719331    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q64xr\" (UniqueName: \"kubernetes.io/projected/80cf95a4-bc10-49b2-890a-a6fce864cb77-kube-api-access-q64xr\") pod \"e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") " pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.808184 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.808089    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:25.950241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:25.950192    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"]
Aug 04 13:07:25.952994 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:07:25.952961    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80cf95a4_bc10_49b2_890a_a6fce864cb77.slice/crio-b6d5faf918390ab9d84be1b2f0b8c8642f9ccd24998e8044c2e3a3ad1b9f85fb WatchSource:0}: Error finding container b6d5faf918390ab9d84be1b2f0b8c8642f9ccd24998e8044c2e3a3ad1b9f85fb: Status 404 returned error can't find the container with id b6d5faf918390ab9d84be1b2f0b8c8642f9ccd24998e8044c2e3a3ad1b9f85fb
Aug 04 13:07:26.100397 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:26.100358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx" event={"ID":"80cf95a4-bc10-49b2-890a-a6fce864cb77","Type":"ContainerStarted","Data":"358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53"}
Aug 04 13:07:26.100574 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:26.100420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx" event={"ID":"80cf95a4-bc10-49b2-890a-a6fce864cb77","Type":"ContainerStarted","Data":"b6d5faf918390ab9d84be1b2f0b8c8642f9ccd24998e8044c2e3a3ad1b9f85fb"}
Aug 04 13:07:35.809189 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:35.809153    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:35.809189 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:35.809200    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:35.821801 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:35.821775    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:07:35.841482 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:35.841436    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx" podStartSLOduration=10.841410336 podStartE2EDuration="10.841410336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:07:26.119302952 +0000 UTC m=+2403.643177680" watchObservedRunningTime="2026-08-04 13:07:35.841410336 +0000 UTC m=+2413.365285054"
Aug 04 13:07:36.160760 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:07:36.160721    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:08:10.094947 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.094847    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"]
Aug 04 13:08:10.095520 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.095105    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4" podUID="3487cd42-c317-4eef-9f5f-5289d03b248d" containerName="payload-pre-processing" containerID="cri-o://5f552e7c23ffa374143919f55707933bf27ec0e11909eea1fadb63d42a4f8c6c" gracePeriod=30
Aug 04 13:08:10.319362 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.319331    2574 generic.go:356] "Generic (PLEG): container finished" podID="3487cd42-c317-4eef-9f5f-5289d03b248d" containerID="5f552e7c23ffa374143919f55707933bf27ec0e11909eea1fadb63d42a4f8c6c" exitCode=0
Aug 04 13:08:10.319561 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.319435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4" event={"ID":"3487cd42-c317-4eef-9f5f-5289d03b248d","Type":"ContainerDied","Data":"5f552e7c23ffa374143919f55707933bf27ec0e11909eea1fadb63d42a4f8c6c"}
Aug 04 13:08:10.364083 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.364057    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:08:10.415711 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.415685    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpkrr\" (UniqueName: \"kubernetes.io/projected/3487cd42-c317-4eef-9f5f-5289d03b248d-kube-api-access-kpkrr\") pod \"3487cd42-c317-4eef-9f5f-5289d03b248d\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") "
Aug 04 13:08:10.415869 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.415724    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3487cd42-c317-4eef-9f5f-5289d03b248d-plugins-config-volume\") pod \"3487cd42-c317-4eef-9f5f-5289d03b248d\" (UID: \"3487cd42-c317-4eef-9f5f-5289d03b248d\") "
Aug 04 13:08:10.416216 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.416182    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3487cd42-c317-4eef-9f5f-5289d03b248d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3487cd42-c317-4eef-9f5f-5289d03b248d" (UID: "3487cd42-c317-4eef-9f5f-5289d03b248d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:08:10.417907 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.417877    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3487cd42-c317-4eef-9f5f-5289d03b248d-kube-api-access-kpkrr" (OuterVolumeSpecName: "kube-api-access-kpkrr") pod "3487cd42-c317-4eef-9f5f-5289d03b248d" (UID: "3487cd42-c317-4eef-9f5f-5289d03b248d"). InnerVolumeSpecName "kube-api-access-kpkrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:08:10.517146 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.517110    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpkrr\" (UniqueName: \"kubernetes.io/projected/3487cd42-c317-4eef-9f5f-5289d03b248d-kube-api-access-kpkrr\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:10.517146 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:10.517142    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3487cd42-c317-4eef-9f5f-5289d03b248d-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:11.326053 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:11.325977    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"
Aug 04 13:08:11.326053 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:11.326006    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4" event={"ID":"3487cd42-c317-4eef-9f5f-5289d03b248d","Type":"ContainerDied","Data":"3cd0dd2fb7d8a434b9f81ba4d7faf0c18d61f25e68bc871b4a9733f8fe4f51c9"}
Aug 04 13:08:11.326680 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:11.326065    2574 scope.go:117] "RemoveContainer" containerID="5f552e7c23ffa374143919f55707933bf27ec0e11909eea1fadb63d42a4f8c6c"
Aug 04 13:08:11.344405 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:11.344361    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"]
Aug 04 13:08:11.350983 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:11.350958    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f758d543-bffc7cf8d-cswd4"]
Aug 04 13:08:12.972828 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:12.972798    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3487cd42-c317-4eef-9f5f-5289d03b248d" path="/var/lib/kubelet/pods/3487cd42-c317-4eef-9f5f-5289d03b248d/volumes"
Aug 04 13:08:18.578245 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:18.578215    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"]
Aug 04 13:08:33.597790 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.597735    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx" podUID="80cf95a4-bc10-49b2-890a-a6fce864cb77" containerName="main" containerID="cri-o://358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53" gracePeriod=45
Aug 04 13:08:33.852424 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.852350    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:08:33.931654 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931620    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-model-cache\") pod \"80cf95a4-bc10-49b2-890a-a6fce864cb77\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") "
Aug 04 13:08:33.931840 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931707    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-dshm\") pod \"80cf95a4-bc10-49b2-890a-a6fce864cb77\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") "
Aug 04 13:08:33.931840 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931730    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf95a4-bc10-49b2-890a-a6fce864cb77-tls-certs\") pod \"80cf95a4-bc10-49b2-890a-a6fce864cb77\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") "
Aug 04 13:08:33.931840 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931765    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q64xr\" (UniqueName: \"kubernetes.io/projected/80cf95a4-bc10-49b2-890a-a6fce864cb77-kube-api-access-q64xr\") pod \"80cf95a4-bc10-49b2-890a-a6fce864cb77\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") "
Aug 04 13:08:33.931840 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931796    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-home\") pod \"80cf95a4-bc10-49b2-890a-a6fce864cb77\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") "
Aug 04 13:08:33.932058 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931902    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-model-cache" (OuterVolumeSpecName: "model-cache") pod "80cf95a4-bc10-49b2-890a-a6fce864cb77" (UID: "80cf95a4-bc10-49b2-890a-a6fce864cb77"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:08:33.932058 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.931925    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-tmp-dir\") pod \"80cf95a4-bc10-49b2-890a-a6fce864cb77\" (UID: \"80cf95a4-bc10-49b2-890a-a6fce864cb77\") "
Aug 04 13:08:33.932058 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.932039    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-home" (OuterVolumeSpecName: "home") pod "80cf95a4-bc10-49b2-890a-a6fce864cb77" (UID: "80cf95a4-bc10-49b2-890a-a6fce864cb77"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:08:33.932236 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.932171    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "80cf95a4-bc10-49b2-890a-a6fce864cb77" (UID: "80cf95a4-bc10-49b2-890a-a6fce864cb77"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:08:33.932299 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.932281    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:33.932357 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.932303    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:33.932357 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.932312    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:33.934033 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.934008    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80cf95a4-bc10-49b2-890a-a6fce864cb77-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "80cf95a4-bc10-49b2-890a-a6fce864cb77" (UID: "80cf95a4-bc10-49b2-890a-a6fce864cb77"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:08:33.934150 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.934035    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-dshm" (OuterVolumeSpecName: "dshm") pod "80cf95a4-bc10-49b2-890a-a6fce864cb77" (UID: "80cf95a4-bc10-49b2-890a-a6fce864cb77"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:08:33.934150 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:33.934120    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80cf95a4-bc10-49b2-890a-a6fce864cb77-kube-api-access-q64xr" (OuterVolumeSpecName: "kube-api-access-q64xr") pod "80cf95a4-bc10-49b2-890a-a6fce864cb77" (UID: "80cf95a4-bc10-49b2-890a-a6fce864cb77"). InnerVolumeSpecName "kube-api-access-q64xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:08:34.033591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.033548    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf95a4-bc10-49b2-890a-a6fce864cb77-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:34.033591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.033582    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf95a4-bc10-49b2-890a-a6fce864cb77-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:34.033591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.033597    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q64xr\" (UniqueName: \"kubernetes.io/projected/80cf95a4-bc10-49b2-890a-a6fce864cb77-kube-api-access-q64xr\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:08:34.434733 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.434697    2574 generic.go:356] "Generic (PLEG): container finished" podID="80cf95a4-bc10-49b2-890a-a6fce864cb77" containerID="358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53" exitCode=0
Aug 04 13:08:34.434916 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.434759    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"
Aug 04 13:08:34.434916 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.434766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx" event={"ID":"80cf95a4-bc10-49b2-890a-a6fce864cb77","Type":"ContainerDied","Data":"358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53"}
Aug 04 13:08:34.434916 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.434805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx" event={"ID":"80cf95a4-bc10-49b2-890a-a6fce864cb77","Type":"ContainerDied","Data":"b6d5faf918390ab9d84be1b2f0b8c8642f9ccd24998e8044c2e3a3ad1b9f85fb"}
Aug 04 13:08:34.434916 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.434821    2574 scope.go:117] "RemoveContainer" containerID="358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53"
Aug 04 13:08:34.444043 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.444023    2574 scope.go:117] "RemoveContainer" containerID="358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53"
Aug 04 13:08:34.444297 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:08:34.444277    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53\": container with ID starting with 358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53 not found: ID does not exist" containerID="358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53"
Aug 04 13:08:34.444337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.444307    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53"} err="failed to get container status \"358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53\": rpc error: code = NotFound desc = could not find container \"358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53\": container with ID starting with 358ad25def57e25d04ef312ba66338b8b582a433b4d61734ebb1e62b1fd07b53 not found: ID does not exist"
Aug 04 13:08:34.463046 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.463021    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"]
Aug 04 13:08:34.481259 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.481218    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f758d543/e2e-lifecycle-model-f758d543-kserve-56cb5b46f9-h2snx"]
Aug 04 13:08:34.972838 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:08:34.972805    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80cf95a4-bc10-49b2-890a-a6fce864cb77" path="/var/lib/kubelet/pods/80cf95a4-bc10-49b2-890a-a6fce864cb77/volumes"
Aug 04 13:09:59.321107 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321075    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"]
Aug 04 13:09:59.321591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321481    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80cf95a4-bc10-49b2-890a-a6fce864cb77" containerName="main"
Aug 04 13:09:59.321591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321494    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="80cf95a4-bc10-49b2-890a-a6fce864cb77" containerName="main"
Aug 04 13:09:59.321591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321509    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3487cd42-c317-4eef-9f5f-5289d03b248d" containerName="payload-pre-processing"
Aug 04 13:09:59.321591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321515    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3487cd42-c317-4eef-9f5f-5289d03b248d" containerName="payload-pre-processing"
Aug 04 13:09:59.321591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321579    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3487cd42-c317-4eef-9f5f-5289d03b248d" containerName="payload-pre-processing"
Aug 04 13:09:59.321591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.321591    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="80cf95a4-bc10-49b2-890a-a6fce864cb77" containerName="main"
Aug 04 13:09:59.324576 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.324559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.328319 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.328291    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1c6080\""
Aug 04 13:09:59.328473 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.328423    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-1c6080-dockercfg-9l28p\""
Aug 04 13:09:59.339932 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.339905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"]
Aug 04 13:09:59.367812 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.367773    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9314cc58-23f3-41b6-b4b5-1ae79386b850-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.367986 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.367836    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcbk\" (UniqueName: \"kubernetes.io/projected/9314cc58-23f3-41b6-b4b5-1ae79386b850-kube-api-access-4zcbk\") pod \"payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.469330 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.469289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9314cc58-23f3-41b6-b4b5-1ae79386b850-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.469549 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.469347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcbk\" (UniqueName: \"kubernetes.io/projected/9314cc58-23f3-41b6-b4b5-1ae79386b850-kube-api-access-4zcbk\") pod \"payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.470126 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.470106    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9314cc58-23f3-41b6-b4b5-1ae79386b850-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.481246 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.481213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcbk\" (UniqueName: \"kubernetes.io/projected/9314cc58-23f3-41b6-b4b5-1ae79386b850-kube-api-access-4zcbk\") pod \"payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.634763 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.634730    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.784431 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.784407    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"]
Aug 04 13:09:59.786821 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:09:59.786787    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9314cc58_23f3_41b6_b4b5_1ae79386b850.slice/crio-2df6fff19c3b0b7a9cd43e3ad425649a073b9aee7c6fdd858d722ed9f2ae4222 WatchSource:0}: Error finding container 2df6fff19c3b0b7a9cd43e3ad425649a073b9aee7c6fdd858d722ed9f2ae4222: Status 404 returned error can't find the container with id 2df6fff19c3b0b7a9cd43e3ad425649a073b9aee7c6fdd858d722ed9f2ae4222
Aug 04 13:09:59.859900 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.859873    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" event={"ID":"9314cc58-23f3-41b6-b4b5-1ae79386b850","Type":"ContainerStarted","Data":"50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325"}
Aug 04 13:09:59.860066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.859922    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" event={"ID":"9314cc58-23f3-41b6-b4b5-1ae79386b850","Type":"ContainerStarted","Data":"2df6fff19c3b0b7a9cd43e3ad425649a073b9aee7c6fdd858d722ed9f2ae4222"}
Aug 04 13:09:59.860066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.859991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:09:59.881760 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:09:59.881721    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" podStartSLOduration=0.881708737 podStartE2EDuration="881.708737ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:09:59.880651283 +0000 UTC m=+2557.404526021" watchObservedRunningTime="2026-08-04 13:09:59.881708737 +0000 UTC m=+2557.405583463"
Aug 04 13:10:10.867292 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:10.867249    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" podUID="9314cc58-23f3-41b6-b4b5-1ae79386b850" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.53:9004: connect: connection refused"
Aug 04 13:10:20.866570 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:20.866535    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:10:28.383137 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.383098    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"]
Aug 04 13:10:28.386632 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.386614    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.389733 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.389710    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-3a8b01\""
Aug 04 13:10:28.403241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.403213    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"]
Aug 04 13:10:28.406714 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.406692    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"]
Aug 04 13:10:28.406825 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.406782    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.421231 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.421206    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"]
Aug 04 13:10:28.528732 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.528690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62f174f2-728d-4efb-a57f-f3d2660e149d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.528908 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.528881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7r6\" (UniqueName: \"kubernetes.io/projected/62f174f2-728d-4efb-a57f-f3d2660e149d-kube-api-access-2j7r6\") pod \"payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.529080 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.529051    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc4qx\" (UniqueName: \"kubernetes.io/projected/5061e1c3-1555-4366-816f-38d7f5154478-kube-api-access-cc4qx\") pod \"payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.529219 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.529098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5061e1c3-1555-4366-816f-38d7f5154478-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.630055 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.630022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62f174f2-728d-4efb-a57f-f3d2660e149d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.630229 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.630070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7r6\" (UniqueName: \"kubernetes.io/projected/62f174f2-728d-4efb-a57f-f3d2660e149d-kube-api-access-2j7r6\") pod \"payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.630229 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.630133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc4qx\" (UniqueName: \"kubernetes.io/projected/5061e1c3-1555-4366-816f-38d7f5154478-kube-api-access-cc4qx\") pod \"payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.630229 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.630151    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5061e1c3-1555-4366-816f-38d7f5154478-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.630944 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.630916    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62f174f2-728d-4efb-a57f-f3d2660e149d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.631064 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.631029    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5061e1c3-1555-4366-816f-38d7f5154478-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.642629 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.642567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc4qx\" (UniqueName: \"kubernetes.io/projected/5061e1c3-1555-4366-816f-38d7f5154478-kube-api-access-cc4qx\") pod \"payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.642629 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.642567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7r6\" (UniqueName: \"kubernetes.io/projected/62f174f2-728d-4efb-a57f-f3d2660e149d-kube-api-access-2j7r6\") pod \"payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.697036 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.697007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:28.717570 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.717536    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.852347 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.852255    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"]
Aug 04 13:10:28.854498 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:10:28.854455    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f174f2_728d_4efb_a57f_f3d2660e149d.slice/crio-b405ee8a96bb00b431e9b6ff41d7b40806750d76ba1cd7f7403c58d76ecfb788 WatchSource:0}: Error finding container b405ee8a96bb00b431e9b6ff41d7b40806750d76ba1cd7f7403c58d76ecfb788: Status 404 returned error can't find the container with id b405ee8a96bb00b431e9b6ff41d7b40806750d76ba1cd7f7403c58d76ecfb788
Aug 04 13:10:28.881850 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.881829    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"]
Aug 04 13:10:28.884567 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:10:28.884528    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5061e1c3_1555_4366_816f_38d7f5154478.slice/crio-15d94af19289ab8b801d66dd619cef9663bb2b44e31827f3dfba791e0a73ec9d WatchSource:0}: Error finding container 15d94af19289ab8b801d66dd619cef9663bb2b44e31827f3dfba791e0a73ec9d: Status 404 returned error can't find the container with id 15d94af19289ab8b801d66dd619cef9663bb2b44e31827f3dfba791e0a73ec9d
Aug 04 13:10:28.995844 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.995810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6" event={"ID":"5061e1c3-1555-4366-816f-38d7f5154478","Type":"ContainerStarted","Data":"aa29bf7674e9290e3fe7653a472c50c13196e1fe2c51f4242238cabefc686c68"}
Aug 04 13:10:28.996041 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.995991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:28.996124 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.996046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6" event={"ID":"5061e1c3-1555-4366-816f-38d7f5154478","Type":"ContainerStarted","Data":"15d94af19289ab8b801d66dd619cef9663bb2b44e31827f3dfba791e0a73ec9d"}
Aug 04 13:10:28.997337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.997311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw" event={"ID":"62f174f2-728d-4efb-a57f-f3d2660e149d","Type":"ContainerStarted","Data":"2bc0880bf4275adb6dff7a7101a66b11672255462c7c207482440a308b101eb8"}
Aug 04 13:10:28.997470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.997355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw" event={"ID":"62f174f2-728d-4efb-a57f-f3d2660e149d","Type":"ContainerStarted","Data":"b405ee8a96bb00b431e9b6ff41d7b40806750d76ba1cd7f7403c58d76ecfb788"}
Aug 04 13:10:28.997470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:28.997406    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:10:29.014292 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:29.014247    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6" podStartSLOduration=1.01422741 podStartE2EDuration="1.01422741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:10:29.012874332 +0000 UTC m=+2586.536749059" watchObservedRunningTime="2026-08-04 13:10:29.01422741 +0000 UTC m=+2586.538102162"
Aug 04 13:10:29.033263 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:29.033211    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw" podStartSLOduration=1.033191883 podStartE2EDuration="1.033191883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:10:29.031926065 +0000 UTC m=+2586.555800802" watchObservedRunningTime="2026-08-04 13:10:29.033191883 +0000 UTC m=+2586.557066613"
Aug 04 13:10:40.003407 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:40.003358    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:10:40.003900 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:10:40.003479    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:11:04.511847 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.511754    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"]
Aug 04 13:11:04.515537 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.515514    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.518556 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.518536    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1c6080\"/\"openshift-service-ca.crt\""
Aug 04 13:11:04.519707 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.519688    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1c6080\"/\"kube-root-ca.crt\""
Aug 04 13:11:04.519781 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.519707    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1c6080\"/\"default-dockercfg-nd7g5\""
Aug 04 13:11:04.519781 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.519692    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1c6080\"/\"test-model-1c6080-kserve-self-signed-certs\""
Aug 04 13:11:04.526502 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.526481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"]
Aug 04 13:11:04.642703 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.642674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-tmp-dir\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.642884 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.642725    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69l87\" (UniqueName: \"kubernetes.io/projected/6a478106-435a-46d8-939a-73e67f7ec835-kube-api-access-69l87\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.642884 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.642802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-home\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.642884 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.642840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-model-cache\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.642884 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.642860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-dshm\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.642884 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.642875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a478106-435a-46d8-939a-73e67f7ec835-tls-certs\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744360 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-tmp-dir\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69l87\" (UniqueName: \"kubernetes.io/projected/6a478106-435a-46d8-939a-73e67f7ec835-kube-api-access-69l87\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-home\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744487    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-model-cache\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-dshm\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a478106-435a-46d8-939a-73e67f7ec835-tls-certs\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744835 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744809    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-tmp-dir\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744894 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744842    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-home\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.744948 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.744922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-model-cache\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.746963 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.746939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-dshm\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.747108 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.747092    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a478106-435a-46d8-939a-73e67f7ec835-tls-certs\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.755062 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.755027    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69l87\" (UniqueName: \"kubernetes.io/projected/6a478106-435a-46d8-939a-73e67f7ec835-kube-api-access-69l87\") pod \"test-model-1c6080-kserve-77c9fb4d89-tc7rn\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") " pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.825253 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.825175    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:04.972354 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:11:04.972324    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a478106_435a_46d8_939a_73e67f7ec835.slice/crio-b94dc6b34fa8b7e46c671062b3e639f5f80a5e08a2e4a096e50d535280a564d5 WatchSource:0}: Error finding container b94dc6b34fa8b7e46c671062b3e639f5f80a5e08a2e4a096e50d535280a564d5: Status 404 returned error can't find the container with id b94dc6b34fa8b7e46c671062b3e639f5f80a5e08a2e4a096e50d535280a564d5
Aug 04 13:11:04.973362 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:04.973344    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"]
Aug 04 13:11:05.182648 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:05.182611    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn" event={"ID":"6a478106-435a-46d8-939a-73e67f7ec835","Type":"ContainerStarted","Data":"d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7"}
Aug 04 13:11:05.182648 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:05.182655    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn" event={"ID":"6a478106-435a-46d8-939a-73e67f7ec835","Type":"ContainerStarted","Data":"b94dc6b34fa8b7e46c671062b3e639f5f80a5e08a2e4a096e50d535280a564d5"}
Aug 04 13:11:05.210157 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:05.210106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn" podStartSLOduration=1.210092675 podStartE2EDuration="1.210092675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:11:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:11:05.207944578 +0000 UTC m=+2622.731819305" watchObservedRunningTime="2026-08-04 13:11:05.210092675 +0000 UTC m=+2622.733967402"
Aug 04 13:11:14.826204 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:14.826159    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:14.826739 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:14.826219    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:14.842649 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:14.842621    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:11:15.248826 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:11:15.248788    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:12:01.254356 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:01.254243    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"]
Aug 04 13:12:13.095101 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.095061    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"]
Aug 04 13:12:13.095706 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.095434    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" podUID="9314cc58-23f3-41b6-b4b5-1ae79386b850" containerName="payload-pre-processing" containerID="cri-o://50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325" gracePeriod=30
Aug 04 13:12:13.358713 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.358650    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:12:13.377402 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.377356    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9314cc58-23f3-41b6-b4b5-1ae79386b850-plugins-config-volume\") pod \"9314cc58-23f3-41b6-b4b5-1ae79386b850\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") "
Aug 04 13:12:13.377554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.377497    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zcbk\" (UniqueName: \"kubernetes.io/projected/9314cc58-23f3-41b6-b4b5-1ae79386b850-kube-api-access-4zcbk\") pod \"9314cc58-23f3-41b6-b4b5-1ae79386b850\" (UID: \"9314cc58-23f3-41b6-b4b5-1ae79386b850\") "
Aug 04 13:12:13.377739 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.377718    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9314cc58-23f3-41b6-b4b5-1ae79386b850-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9314cc58-23f3-41b6-b4b5-1ae79386b850" (UID: "9314cc58-23f3-41b6-b4b5-1ae79386b850"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:12:13.377812 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.377799    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9314cc58-23f3-41b6-b4b5-1ae79386b850-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:13.380090 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.380057    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9314cc58-23f3-41b6-b4b5-1ae79386b850-kube-api-access-4zcbk" (OuterVolumeSpecName: "kube-api-access-4zcbk") pod "9314cc58-23f3-41b6-b4b5-1ae79386b850" (UID: "9314cc58-23f3-41b6-b4b5-1ae79386b850"). InnerVolumeSpecName "kube-api-access-4zcbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:12:13.484230 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.479369    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcbk\" (UniqueName: \"kubernetes.io/projected/9314cc58-23f3-41b6-b4b5-1ae79386b850-kube-api-access-4zcbk\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:13.521990 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.521952    2574 generic.go:356] "Generic (PLEG): container finished" podID="9314cc58-23f3-41b6-b4b5-1ae79386b850" containerID="50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325" exitCode=0
Aug 04 13:12:13.522165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.522012    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"
Aug 04 13:12:13.522165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.522022    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" event={"ID":"9314cc58-23f3-41b6-b4b5-1ae79386b850","Type":"ContainerDied","Data":"50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325"}
Aug 04 13:12:13.522165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.522103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z" event={"ID":"9314cc58-23f3-41b6-b4b5-1ae79386b850","Type":"ContainerDied","Data":"2df6fff19c3b0b7a9cd43e3ad425649a073b9aee7c6fdd858d722ed9f2ae4222"}
Aug 04 13:12:13.522165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.522132    2574 scope.go:117] "RemoveContainer" containerID="50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325"
Aug 04 13:12:13.531471 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.531451    2574 scope.go:117] "RemoveContainer" containerID="50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325"
Aug 04 13:12:13.531781 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:12:13.531759    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325\": container with ID starting with 50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325 not found: ID does not exist" containerID="50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325"
Aug 04 13:12:13.531881 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.531794    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325"} err="failed to get container status \"50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325\": rpc error: code = NotFound desc = could not find container \"50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325\": container with ID starting with 50eade29b4827e3aadc43e9f3c3ba80e000dcec58f59f69f6358a210aa5b2325 not found: ID does not exist"
Aug 04 13:12:13.547035 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.546999    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"]
Aug 04 13:12:13.553039 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:13.553018    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1c6080-7b5587d65b-h4b6z"]
Aug 04 13:12:14.972351 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:14.972315    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9314cc58-23f3-41b6-b4b5-1ae79386b850" path="/var/lib/kubelet/pods/9314cc58-23f3-41b6-b4b5-1ae79386b850/volumes"
Aug 04 13:12:16.277122 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.277079    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn" podUID="6a478106-435a-46d8-939a-73e67f7ec835" containerName="main" containerID="cri-o://d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7" gracePeriod=45
Aug 04 13:12:16.526701 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.526679    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:12:16.539796 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.539728    2574 generic.go:356] "Generic (PLEG): container finished" podID="6a478106-435a-46d8-939a-73e67f7ec835" containerID="d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7" exitCode=0
Aug 04 13:12:16.539796 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.539769    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"
Aug 04 13:12:16.539796 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.539776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn" event={"ID":"6a478106-435a-46d8-939a-73e67f7ec835","Type":"ContainerDied","Data":"d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7"}
Aug 04 13:12:16.539796 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.539802    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn" event={"ID":"6a478106-435a-46d8-939a-73e67f7ec835","Type":"ContainerDied","Data":"b94dc6b34fa8b7e46c671062b3e639f5f80a5e08a2e4a096e50d535280a564d5"}
Aug 04 13:12:16.540087 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.539822    2574 scope.go:117] "RemoveContainer" containerID="d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7"
Aug 04 13:12:16.549741 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.549718    2574 scope.go:117] "RemoveContainer" containerID="d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7"
Aug 04 13:12:16.550046 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:12:16.550025    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7\": container with ID starting with d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7 not found: ID does not exist" containerID="d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7"
Aug 04 13:12:16.550137 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.550060    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7"} err="failed to get container status \"d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7\": rpc error: code = NotFound desc = could not find container \"d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7\": container with ID starting with d93df5389524aced2ac66bbe15abca256c544a3a9244606a3e354bebc6227cd7 not found: ID does not exist"
Aug 04 13:12:16.607306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a478106-435a-46d8-939a-73e67f7ec835-tls-certs\") pod \"6a478106-435a-46d8-939a-73e67f7ec835\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") "
Aug 04 13:12:16.607521 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607315    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-dshm\") pod \"6a478106-435a-46d8-939a-73e67f7ec835\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") "
Aug 04 13:12:16.607521 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607352    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-home\") pod \"6a478106-435a-46d8-939a-73e67f7ec835\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") "
Aug 04 13:12:16.607521 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607431    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-tmp-dir\") pod \"6a478106-435a-46d8-939a-73e67f7ec835\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") "
Aug 04 13:12:16.607521 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607460    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69l87\" (UniqueName: \"kubernetes.io/projected/6a478106-435a-46d8-939a-73e67f7ec835-kube-api-access-69l87\") pod \"6a478106-435a-46d8-939a-73e67f7ec835\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") "
Aug 04 13:12:16.607742 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607535    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-model-cache\") pod \"6a478106-435a-46d8-939a-73e67f7ec835\" (UID: \"6a478106-435a-46d8-939a-73e67f7ec835\") "
Aug 04 13:12:16.607742 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607699    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-home" (OuterVolumeSpecName: "home") pod "6a478106-435a-46d8-939a-73e67f7ec835" (UID: "6a478106-435a-46d8-939a-73e67f7ec835"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:12:16.607742 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607717    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a478106-435a-46d8-939a-73e67f7ec835" (UID: "6a478106-435a-46d8-939a-73e67f7ec835"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:12:16.607882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607860    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a478106-435a-46d8-939a-73e67f7ec835" (UID: "6a478106-435a-46d8-939a-73e67f7ec835"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:12:16.607934 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607890    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:16.607934 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.607911    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:16.609739 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.609720    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a478106-435a-46d8-939a-73e67f7ec835-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a478106-435a-46d8-939a-73e67f7ec835" (UID: "6a478106-435a-46d8-939a-73e67f7ec835"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:12:16.610125 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.610107    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-dshm" (OuterVolumeSpecName: "dshm") pod "6a478106-435a-46d8-939a-73e67f7ec835" (UID: "6a478106-435a-46d8-939a-73e67f7ec835"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:12:16.610177 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.610132    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a478106-435a-46d8-939a-73e67f7ec835-kube-api-access-69l87" (OuterVolumeSpecName: "kube-api-access-69l87") pod "6a478106-435a-46d8-939a-73e67f7ec835" (UID: "6a478106-435a-46d8-939a-73e67f7ec835"). InnerVolumeSpecName "kube-api-access-69l87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:12:16.708367 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.708331    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69l87\" (UniqueName: \"kubernetes.io/projected/6a478106-435a-46d8-939a-73e67f7ec835-kube-api-access-69l87\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:16.708367 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.708364    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:16.708604 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.708379    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a478106-435a-46d8-939a-73e67f7ec835-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:16.708604 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.708418    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a478106-435a-46d8-939a-73e67f7ec835-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:16.865144 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.865115    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"]
Aug 04 13:12:16.870318 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.870294    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1c6080/test-model-1c6080-kserve-77c9fb4d89-tc7rn"]
Aug 04 13:12:16.972038 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:16.972003    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a478106-435a-46d8-939a-73e67f7ec835" path="/var/lib/kubelet/pods/6a478106-435a-46d8-939a-73e67f7ec835/volumes"
Aug 04 13:12:23.124276 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:23.124250    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:12:23.127677 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:23.127654    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:12:31.361294 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.361256    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"]
Aug 04 13:12:31.361826 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.361545    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6" podUID="5061e1c3-1555-4366-816f-38d7f5154478" containerName="payload-processing" containerID="cri-o://aa29bf7674e9290e3fe7653a472c50c13196e1fe2c51f4242238cabefc686c68" gracePeriod=30
Aug 04 13:12:31.369384 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.369355    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"]
Aug 04 13:12:31.369716 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.369670    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw" podUID="62f174f2-728d-4efb-a57f-f3d2660e149d" containerName="payload-pre-processing" containerID="cri-o://2bc0880bf4275adb6dff7a7101a66b11672255462c7c207482440a308b101eb8" gracePeriod=30
Aug 04 13:12:31.618982 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.618913    2574 generic.go:356] "Generic (PLEG): container finished" podID="5061e1c3-1555-4366-816f-38d7f5154478" containerID="aa29bf7674e9290e3fe7653a472c50c13196e1fe2c51f4242238cabefc686c68" exitCode=0
Aug 04 13:12:31.619228 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.618984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6" event={"ID":"5061e1c3-1555-4366-816f-38d7f5154478","Type":"ContainerDied","Data":"aa29bf7674e9290e3fe7653a472c50c13196e1fe2c51f4242238cabefc686c68"}
Aug 04 13:12:31.619228 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.619047    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6" event={"ID":"5061e1c3-1555-4366-816f-38d7f5154478","Type":"ContainerDied","Data":"15d94af19289ab8b801d66dd619cef9663bb2b44e31827f3dfba791e0a73ec9d"}
Aug 04 13:12:31.619228 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.619069    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15d94af19289ab8b801d66dd619cef9663bb2b44e31827f3dfba791e0a73ec9d"
Aug 04 13:12:31.620785 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.620761    2574 generic.go:356] "Generic (PLEG): container finished" podID="62f174f2-728d-4efb-a57f-f3d2660e149d" containerID="2bc0880bf4275adb6dff7a7101a66b11672255462c7c207482440a308b101eb8" exitCode=0
Aug 04 13:12:31.620918 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.620835    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw" event={"ID":"62f174f2-728d-4efb-a57f-f3d2660e149d","Type":"ContainerDied","Data":"2bc0880bf4275adb6dff7a7101a66b11672255462c7c207482440a308b101eb8"}
Aug 04 13:12:31.624695 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.624675    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:12:31.661460 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.661434    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:12:31.739167 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.739132    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7r6\" (UniqueName: \"kubernetes.io/projected/62f174f2-728d-4efb-a57f-f3d2660e149d-kube-api-access-2j7r6\") pod \"62f174f2-728d-4efb-a57f-f3d2660e149d\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") "
Aug 04 13:12:31.739355 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.739190    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5061e1c3-1555-4366-816f-38d7f5154478-plugins-config-volume\") pod \"5061e1c3-1555-4366-816f-38d7f5154478\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") "
Aug 04 13:12:31.739355 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.739244    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc4qx\" (UniqueName: \"kubernetes.io/projected/5061e1c3-1555-4366-816f-38d7f5154478-kube-api-access-cc4qx\") pod \"5061e1c3-1555-4366-816f-38d7f5154478\" (UID: \"5061e1c3-1555-4366-816f-38d7f5154478\") "
Aug 04 13:12:31.739355 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.739291    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62f174f2-728d-4efb-a57f-f3d2660e149d-plugins-config-volume\") pod \"62f174f2-728d-4efb-a57f-f3d2660e149d\" (UID: \"62f174f2-728d-4efb-a57f-f3d2660e149d\") "
Aug 04 13:12:31.739714 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.739683    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5061e1c3-1555-4366-816f-38d7f5154478-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5061e1c3-1555-4366-816f-38d7f5154478" (UID: "5061e1c3-1555-4366-816f-38d7f5154478"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:12:31.739829 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.739771    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62f174f2-728d-4efb-a57f-f3d2660e149d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62f174f2-728d-4efb-a57f-f3d2660e149d" (UID: "62f174f2-728d-4efb-a57f-f3d2660e149d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:12:31.742005 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.741978    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5061e1c3-1555-4366-816f-38d7f5154478-kube-api-access-cc4qx" (OuterVolumeSpecName: "kube-api-access-cc4qx") pod "5061e1c3-1555-4366-816f-38d7f5154478" (UID: "5061e1c3-1555-4366-816f-38d7f5154478"). InnerVolumeSpecName "kube-api-access-cc4qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:12:31.742106 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.741999    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f174f2-728d-4efb-a57f-f3d2660e149d-kube-api-access-2j7r6" (OuterVolumeSpecName: "kube-api-access-2j7r6") pod "62f174f2-728d-4efb-a57f-f3d2660e149d" (UID: "62f174f2-728d-4efb-a57f-f3d2660e149d"). InnerVolumeSpecName "kube-api-access-2j7r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:12:31.840701 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.840661    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62f174f2-728d-4efb-a57f-f3d2660e149d-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:31.840701 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.840693    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7r6\" (UniqueName: \"kubernetes.io/projected/62f174f2-728d-4efb-a57f-f3d2660e149d-kube-api-access-2j7r6\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:31.840701 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.840702    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5061e1c3-1555-4366-816f-38d7f5154478-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:31.840924 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:31.840713    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc4qx\" (UniqueName: \"kubernetes.io/projected/5061e1c3-1555-4366-816f-38d7f5154478-kube-api-access-cc4qx\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:12:32.626774 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.626745    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"
Aug 04 13:12:32.627165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.626787    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw" event={"ID":"62f174f2-728d-4efb-a57f-f3d2660e149d","Type":"ContainerDied","Data":"b405ee8a96bb00b431e9b6ff41d7b40806750d76ba1cd7f7403c58d76ecfb788"}
Aug 04 13:12:32.627165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.626851    2574 scope.go:117] "RemoveContainer" containerID="2bc0880bf4275adb6dff7a7101a66b11672255462c7c207482440a308b101eb8"
Aug 04 13:12:32.627165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.626964    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"
Aug 04 13:12:32.654140 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.654116    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"]
Aug 04 13:12:32.660988 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.660966    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3a8b01-5f8d57c56-g29kw"]
Aug 04 13:12:32.672996 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.672977    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"]
Aug 04 13:12:32.682072 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.682052    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3a8b01-5bfb9ccb4b-cv7d6"]
Aug 04 13:12:32.972515 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.972431    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5061e1c3-1555-4366-816f-38d7f5154478" path="/var/lib/kubelet/pods/5061e1c3-1555-4366-816f-38d7f5154478/volumes"
Aug 04 13:12:32.972845 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:32.972831    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f174f2-728d-4efb-a57f-f3d2660e149d" path="/var/lib/kubelet/pods/62f174f2-728d-4efb-a57f-f3d2660e149d/volumes"
Aug 04 13:12:43.936134 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936096    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"]
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936637    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9314cc58-23f3-41b6-b4b5-1ae79386b850" containerName="payload-pre-processing"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936657    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9314cc58-23f3-41b6-b4b5-1ae79386b850" containerName="payload-pre-processing"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936676    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f174f2-728d-4efb-a57f-f3d2660e149d" containerName="payload-pre-processing"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936686    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f174f2-728d-4efb-a57f-f3d2660e149d" containerName="payload-pre-processing"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936713    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5061e1c3-1555-4366-816f-38d7f5154478" containerName="payload-processing"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936722    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5061e1c3-1555-4366-816f-38d7f5154478" containerName="payload-processing"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936734    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a478106-435a-46d8-939a-73e67f7ec835" containerName="main"
Aug 04 13:12:43.936754 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936742    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a478106-435a-46d8-939a-73e67f7ec835" containerName="main"
Aug 04 13:12:43.937160 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936820    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f174f2-728d-4efb-a57f-f3d2660e149d" containerName="payload-pre-processing"
Aug 04 13:12:43.937160 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936834    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5061e1c3-1555-4366-816f-38d7f5154478" containerName="payload-processing"
Aug 04 13:12:43.937160 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936844    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9314cc58-23f3-41b6-b4b5-1ae79386b850" containerName="payload-pre-processing"
Aug 04 13:12:43.937160 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.936854    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a478106-435a-46d8-939a-73e67f7ec835" containerName="main"
Aug 04 13:12:43.941316 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.941295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:43.944019 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.943997    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0c5286\""
Aug 04 13:12:43.944148 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.943998    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0c5286-dockercfg-9rd2n\""
Aug 04 13:12:43.954688 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:43.954665    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"]
Aug 04 13:12:44.052449 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.052404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvpbp\" (UniqueName: \"kubernetes.io/projected/6dd40446-9a7d-49b6-9180-793fd644c8c5-kube-api-access-cvpbp\") pod \"payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.052615 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.052480    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd40446-9a7d-49b6-9180-793fd644c8c5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.153531 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.153497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvpbp\" (UniqueName: \"kubernetes.io/projected/6dd40446-9a7d-49b6-9180-793fd644c8c5-kube-api-access-cvpbp\") pod \"payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.153689 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.153551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd40446-9a7d-49b6-9180-793fd644c8c5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.154178 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.154161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd40446-9a7d-49b6-9180-793fd644c8c5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.162347 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.162321    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvpbp\" (UniqueName: \"kubernetes.io/projected/6dd40446-9a7d-49b6-9180-793fd644c8c5-kube-api-access-cvpbp\") pod \"payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.251926 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.251851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.387057 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.387031    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"]
Aug 04 13:12:44.389037 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:12:44.389009    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd40446_9a7d_49b6_9180_793fd644c8c5.slice/crio-833e05233e3a4028d6971ea4a395f5e69bbf761917fcd12c2794bb6dbd69b80c WatchSource:0}: Error finding container 833e05233e3a4028d6971ea4a395f5e69bbf761917fcd12c2794bb6dbd69b80c: Status 404 returned error can't find the container with id 833e05233e3a4028d6971ea4a395f5e69bbf761917fcd12c2794bb6dbd69b80c
Aug 04 13:12:44.689725 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.689692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26" event={"ID":"6dd40446-9a7d-49b6-9180-793fd644c8c5","Type":"ContainerStarted","Data":"732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59"}
Aug 04 13:12:44.689901 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.689739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26" event={"ID":"6dd40446-9a7d-49b6-9180-793fd644c8c5","Type":"ContainerStarted","Data":"833e05233e3a4028d6971ea4a395f5e69bbf761917fcd12c2794bb6dbd69b80c"}
Aug 04 13:12:44.689901 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.689794    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:12:44.710335 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:44.710278    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26" podStartSLOduration=1.710263804 podStartE2EDuration="1.710263804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:12:44.70843116 +0000 UTC m=+2722.232305888" watchObservedRunningTime="2026-08-04 13:12:44.710263804 +0000 UTC m=+2722.234138530"
Aug 04 13:12:55.697913 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:12:55.697874    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:13:13.216833 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.216784    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"]
Aug 04 13:13:13.220373 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.220357    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.222942 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.222919    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-c1a14d\""
Aug 04 13:13:13.231570 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.231549    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"]
Aug 04 13:13:13.322232 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.322180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.322442 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.322259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5bf\" (UniqueName: \"kubernetes.io/projected/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-kube-api-access-sd5bf\") pod \"payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.423330 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.423290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.423524 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.423345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5bf\" (UniqueName: \"kubernetes.io/projected/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-kube-api-access-sd5bf\") pod \"payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.424004 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.423985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-plugins-config-volume\") pod \"payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.433184 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.433157    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5bf\" (UniqueName: \"kubernetes.io/projected/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-kube-api-access-sd5bf\") pod \"payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") " pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.531877 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.531785    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.674451 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.674420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"]
Aug 04 13:13:13.676474 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:13:13.676447    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d7e01c_b7c5_4ce7_95e6_ad800452b68c.slice/crio-74a36cc5ad303ba1c8f29ac9c63637c70146345cc35ef66fb510025e687592b9 WatchSource:0}: Error finding container 74a36cc5ad303ba1c8f29ac9c63637c70146345cc35ef66fb510025e687592b9: Status 404 returned error can't find the container with id 74a36cc5ad303ba1c8f29ac9c63637c70146345cc35ef66fb510025e687592b9
Aug 04 13:13:13.839515 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.839470    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx" event={"ID":"02d7e01c-b7c5-4ce7-95e6-ad800452b68c","Type":"ContainerStarted","Data":"4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae"}
Aug 04 13:13:13.839713 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.839532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx" event={"ID":"02d7e01c-b7c5-4ce7-95e6-ad800452b68c","Type":"ContainerStarted","Data":"74a36cc5ad303ba1c8f29ac9c63637c70146345cc35ef66fb510025e687592b9"}
Aug 04 13:13:13.839713 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.839572    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:13.857829 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:13.857773    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx" podStartSLOduration=0.857754854 podStartE2EDuration="857.754854ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:13:13.856955635 +0000 UTC m=+2751.380830363" watchObservedRunningTime="2026-08-04 13:13:13.857754854 +0000 UTC m=+2751.381629583"
Aug 04 13:13:24.848160 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:24.848124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:13:52.298644 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.298558    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"]
Aug 04 13:13:52.299172 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.298801    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26" podUID="6dd40446-9a7d-49b6-9180-793fd644c8c5" containerName="payload-processing" containerID="cri-o://732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59" gracePeriod=30
Aug 04 13:13:52.557365 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.557296    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:13:52.573901 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.573856    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvpbp\" (UniqueName: \"kubernetes.io/projected/6dd40446-9a7d-49b6-9180-793fd644c8c5-kube-api-access-cvpbp\") pod \"6dd40446-9a7d-49b6-9180-793fd644c8c5\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") "
Aug 04 13:13:52.574044 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.573945    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd40446-9a7d-49b6-9180-793fd644c8c5-plugins-config-volume\") pod \"6dd40446-9a7d-49b6-9180-793fd644c8c5\" (UID: \"6dd40446-9a7d-49b6-9180-793fd644c8c5\") "
Aug 04 13:13:52.574264 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.574241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd40446-9a7d-49b6-9180-793fd644c8c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6dd40446-9a7d-49b6-9180-793fd644c8c5" (UID: "6dd40446-9a7d-49b6-9180-793fd644c8c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:13:52.576095 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.576069    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd40446-9a7d-49b6-9180-793fd644c8c5-kube-api-access-cvpbp" (OuterVolumeSpecName: "kube-api-access-cvpbp") pod "6dd40446-9a7d-49b6-9180-793fd644c8c5" (UID: "6dd40446-9a7d-49b6-9180-793fd644c8c5"). InnerVolumeSpecName "kube-api-access-cvpbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:13:52.675082 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.675050    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvpbp\" (UniqueName: \"kubernetes.io/projected/6dd40446-9a7d-49b6-9180-793fd644c8c5-kube-api-access-cvpbp\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:13:52.675082 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:52.675080    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6dd40446-9a7d-49b6-9180-793fd644c8c5-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:13:53.039276 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.039238    2574 generic.go:356] "Generic (PLEG): container finished" podID="6dd40446-9a7d-49b6-9180-793fd644c8c5" containerID="732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59" exitCode=0
Aug 04 13:13:53.039457 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.039287    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"
Aug 04 13:13:53.039457 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.039329    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26" event={"ID":"6dd40446-9a7d-49b6-9180-793fd644c8c5","Type":"ContainerDied","Data":"732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59"}
Aug 04 13:13:53.039457 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.039417    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26" event={"ID":"6dd40446-9a7d-49b6-9180-793fd644c8c5","Type":"ContainerDied","Data":"833e05233e3a4028d6971ea4a395f5e69bbf761917fcd12c2794bb6dbd69b80c"}
Aug 04 13:13:53.039457 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.039449    2574 scope.go:117] "RemoveContainer" containerID="732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59"
Aug 04 13:13:53.048085 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.048068    2574 scope.go:117] "RemoveContainer" containerID="732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59"
Aug 04 13:13:53.048326 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:13:53.048307    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59\": container with ID starting with 732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59 not found: ID does not exist" containerID="732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59"
Aug 04 13:13:53.048423 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.048339    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59"} err="failed to get container status \"732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59\": rpc error: code = NotFound desc = could not find container \"732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59\": container with ID starting with 732d21c9e3183b63207969ea5c7f5282eedd18a790a5a05fe7fda331062f4b59 not found: ID does not exist"
Aug 04 13:13:53.060291 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.060267    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"]
Aug 04 13:13:53.066357 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:53.066334    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0c5286-695d5d77b-8fr26"]
Aug 04 13:13:54.973634 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:13:54.973598    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd40446-9a7d-49b6-9180-793fd644c8c5" path="/var/lib/kubelet/pods/6dd40446-9a7d-49b6-9180-793fd644c8c5/volumes"
Aug 04 13:14:11.360835 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.360798    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"]
Aug 04 13:14:11.361514 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.361036    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx" podUID="02d7e01c-b7c5-4ce7-95e6-ad800452b68c" containerName="payload-processing" containerID="cri-o://4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae" gracePeriod=30
Aug 04 13:14:11.609843 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.609820    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:14:11.638928 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.638834    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd5bf\" (UniqueName: \"kubernetes.io/projected/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-kube-api-access-sd5bf\") pod \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") "
Aug 04 13:14:11.639594 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.639574    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-plugins-config-volume\") pod \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\" (UID: \"02d7e01c-b7c5-4ce7-95e6-ad800452b68c\") "
Aug 04 13:14:11.639967 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.639897    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "02d7e01c-b7c5-4ce7-95e6-ad800452b68c" (UID: "02d7e01c-b7c5-4ce7-95e6-ad800452b68c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:14:11.640276 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.640244    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:14:11.641607 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.641579    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-kube-api-access-sd5bf" (OuterVolumeSpecName: "kube-api-access-sd5bf") pod "02d7e01c-b7c5-4ce7-95e6-ad800452b68c" (UID: "02d7e01c-b7c5-4ce7-95e6-ad800452b68c"). InnerVolumeSpecName "kube-api-access-sd5bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:14:11.741734 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:11.741693    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd5bf\" (UniqueName: \"kubernetes.io/projected/02d7e01c-b7c5-4ce7-95e6-ad800452b68c-kube-api-access-sd5bf\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:14:12.130936 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.130896    2574 generic.go:356] "Generic (PLEG): container finished" podID="02d7e01c-b7c5-4ce7-95e6-ad800452b68c" containerID="4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae" exitCode=0
Aug 04 13:14:12.131122 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.130953    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"
Aug 04 13:14:12.131122 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.130982    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx" event={"ID":"02d7e01c-b7c5-4ce7-95e6-ad800452b68c","Type":"ContainerDied","Data":"4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae"}
Aug 04 13:14:12.131122 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.131051    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx" event={"ID":"02d7e01c-b7c5-4ce7-95e6-ad800452b68c","Type":"ContainerDied","Data":"74a36cc5ad303ba1c8f29ac9c63637c70146345cc35ef66fb510025e687592b9"}
Aug 04 13:14:12.131122 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.131085    2574 scope.go:117] "RemoveContainer" containerID="4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae"
Aug 04 13:14:12.141061 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.141039    2574 scope.go:117] "RemoveContainer" containerID="4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae"
Aug 04 13:14:12.141371 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:14:12.141352    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae\": container with ID starting with 4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae not found: ID does not exist" containerID="4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae"
Aug 04 13:14:12.141510 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.141380    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae"} err="failed to get container status \"4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae\": rpc error: code = NotFound desc = could not find container \"4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae\": container with ID starting with 4af3b65c265a23c11877439536014f1eee279a05a8da2c383716fbb6734ebaae not found: ID does not exist"
Aug 04 13:14:12.161665 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.161633    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"]
Aug 04 13:14:12.163214 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.163194    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-c1a14d-dcfb5467d-55pzx"]
Aug 04 13:14:12.977661 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:12.977627    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d7e01c-b7c5-4ce7-95e6-ad800452b68c" path="/var/lib/kubelet/pods/02d7e01c-b7c5-4ce7-95e6-ad800452b68c/volumes"
Aug 04 13:14:25.720014 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.719978    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"]
Aug 04 13:14:25.720440 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.720315    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d7e01c-b7c5-4ce7-95e6-ad800452b68c" containerName="payload-processing"
Aug 04 13:14:25.720440 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.720327    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d7e01c-b7c5-4ce7-95e6-ad800452b68c" containerName="payload-processing"
Aug 04 13:14:25.720440 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.720343    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd40446-9a7d-49b6-9180-793fd644c8c5" containerName="payload-processing"
Aug 04 13:14:25.720440 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.720348    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd40446-9a7d-49b6-9180-793fd644c8c5" containerName="payload-processing"
Aug 04 13:14:25.720577 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.720450    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d7e01c-b7c5-4ce7-95e6-ad800452b68c" containerName="payload-processing"
Aug 04 13:14:25.720577 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.720462    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd40446-9a7d-49b6-9180-793fd644c8c5" containerName="payload-processing"
Aug 04 13:14:25.724579 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.724554    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:25.727865 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.727845    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-6a00c1\""
Aug 04 13:14:25.728150 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.728134    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-6a00c1-dockercfg-77988\""
Aug 04 13:14:25.735953 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.735932    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"]
Aug 04 13:14:25.870242 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.870201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:25.870465 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.870322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc88l\" (UniqueName: \"kubernetes.io/projected/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-kube-api-access-hc88l\") pod \"payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:25.971858 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.971755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:25.971858 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.971840    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc88l\" (UniqueName: \"kubernetes.io/projected/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-kube-api-access-hc88l\") pod \"payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:25.972486 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.972465    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:25.981239 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:25.981205    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc88l\" (UniqueName: \"kubernetes.io/projected/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-kube-api-access-hc88l\") pod \"payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") " pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:26.036549 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:26.036510    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:26.175316 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:26.175294    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"]
Aug 04 13:14:26.176836 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:14:26.176810    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd7a3b9_04f5_4887_a992_0b4b0f3a4016.slice/crio-9bbedb575e4ccd6cf14a06c1b3c7d4f2a3e11c7dcb4010b89396c1cb95378438 WatchSource:0}: Error finding container 9bbedb575e4ccd6cf14a06c1b3c7d4f2a3e11c7dcb4010b89396c1cb95378438: Status 404 returned error can't find the container with id 9bbedb575e4ccd6cf14a06c1b3c7d4f2a3e11c7dcb4010b89396c1cb95378438
Aug 04 13:14:26.204932 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:26.204903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4" event={"ID":"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016","Type":"ContainerStarted","Data":"9bbedb575e4ccd6cf14a06c1b3c7d4f2a3e11c7dcb4010b89396c1cb95378438"}
Aug 04 13:14:27.211688 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:27.211642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4" event={"ID":"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016","Type":"ContainerStarted","Data":"174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7"}
Aug 04 13:14:27.212107 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:27.211762    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:27.231942 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:27.231891    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4" podStartSLOduration=2.231875785 podStartE2EDuration="2.231875785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:14:27.229620045 +0000 UTC m=+2824.753494772" watchObservedRunningTime="2026-08-04 13:14:27.231875785 +0000 UTC m=+2824.755750511"
Aug 04 13:14:38.219009 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:38.218980    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:14:53.914830 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:53.914793    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"]
Aug 04 13:14:53.918216 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:53.918197    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:53.921178 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:53.921157    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-c1c995-dockercfg-rqfbb\""
Aug 04 13:14:53.921317 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:53.921208    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-c1c995\""
Aug 04 13:14:53.929592 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:53.929569    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"]
Aug 04 13:14:54.012653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.012622    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27238ebb-d8c1-4522-8cd0-4652c693c1be-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.012842 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.012659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stv48\" (UniqueName: \"kubernetes.io/projected/27238ebb-d8c1-4522-8cd0-4652c693c1be-kube-api-access-stv48\") pod \"payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.113493 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.113458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27238ebb-d8c1-4522-8cd0-4652c693c1be-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.113697 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.113506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stv48\" (UniqueName: \"kubernetes.io/projected/27238ebb-d8c1-4522-8cd0-4652c693c1be-kube-api-access-stv48\") pod \"payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.114144 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.114122    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27238ebb-d8c1-4522-8cd0-4652c693c1be-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.123901 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.123876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stv48\" (UniqueName: \"kubernetes.io/projected/27238ebb-d8c1-4522-8cd0-4652c693c1be-kube-api-access-stv48\") pod \"payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.229351 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.229273    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:54.372146 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:54.372122    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"]
Aug 04 13:14:54.374265 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:14:54.374238    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27238ebb_d8c1_4522_8cd0_4652c693c1be.slice/crio-ec293e30b0a26803d40789085e3f6ddd60643e0169d71332ed6cc567143f7846 WatchSource:0}: Error finding container ec293e30b0a26803d40789085e3f6ddd60643e0169d71332ed6cc567143f7846: Status 404 returned error can't find the container with id ec293e30b0a26803d40789085e3f6ddd60643e0169d71332ed6cc567143f7846
Aug 04 13:14:55.349795 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:55.349751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc" event={"ID":"27238ebb-d8c1-4522-8cd0-4652c693c1be","Type":"ContainerStarted","Data":"b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333"}
Aug 04 13:14:55.350285 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:55.349819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc" event={"ID":"27238ebb-d8c1-4522-8cd0-4652c693c1be","Type":"ContainerStarted","Data":"ec293e30b0a26803d40789085e3f6ddd60643e0169d71332ed6cc567143f7846"}
Aug 04 13:14:55.350285 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:55.349864    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:14:55.368698 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:14:55.368655    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc" podStartSLOduration=2.368642194 podStartE2EDuration="2.368642194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:14:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:14:55.36793341 +0000 UTC m=+2852.891808138" watchObservedRunningTime="2026-08-04 13:14:55.368642194 +0000 UTC m=+2852.892516963"
Aug 04 13:15:06.357210 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:06.357176    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:15:25.811186 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.811107    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"]
Aug 04 13:15:25.814659 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.814640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.817844 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.817821    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"openshift-service-ca.crt\""
Aug 04 13:15:25.819065 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.819041    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"kube-root-ca.crt\""
Aug 04 13:15:25.819196 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.819078    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"default-dockercfg-st5jw\""
Aug 04 13:15:25.819538 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.819518    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"auth-test-model-6a00c1-kserve-self-signed-certs\""
Aug 04 13:15:25.826238 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.826214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"]
Aug 04 13:15:25.895344 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.895310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fada6-9416-47cf-922f-1211dc553a9b-tls-certs\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.895559 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.895362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-home\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.895559 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.895438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bb2\" (UniqueName: \"kubernetes.io/projected/198fada6-9416-47cf-922f-1211dc553a9b-kube-api-access-86bb2\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.895559 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.895482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-dshm\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.895559 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.895518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-model-cache\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.895559 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.895549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-tmp-dir\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.996730 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.996693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fada6-9416-47cf-922f-1211dc553a9b-tls-certs\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.996900 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.996741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-home\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.996900 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.996856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bb2\" (UniqueName: \"kubernetes.io/projected/198fada6-9416-47cf-922f-1211dc553a9b-kube-api-access-86bb2\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.996979 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.996920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-dshm\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.996979 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.996966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-model-cache\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.997071 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.996990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-tmp-dir\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.997162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.997137    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-home\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.997305 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.997273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-model-cache\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.997372 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.997342    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-tmp-dir\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.999252 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.999233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-dshm\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:25.999356 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:25.999336    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fada6-9416-47cf-922f-1211dc553a9b-tls-certs\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:26.009093 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:26.009070    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bb2\" (UniqueName: \"kubernetes.io/projected/198fada6-9416-47cf-922f-1211dc553a9b-kube-api-access-86bb2\") pod \"auth-test-model-6a00c1-kserve-6c754584ff-8q92c\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") " pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:26.124325 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:26.124295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:26.264988 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:26.264963    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"]
Aug 04 13:15:26.266971 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:15:26.266945    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod198fada6_9416_47cf_922f_1211dc553a9b.slice/crio-4e660203c883dc7a71f6ae968d217cf5243e3bb29c25b0ea8b2609c089875861 WatchSource:0}: Error finding container 4e660203c883dc7a71f6ae968d217cf5243e3bb29c25b0ea8b2609c089875861: Status 404 returned error can't find the container with id 4e660203c883dc7a71f6ae968d217cf5243e3bb29c25b0ea8b2609c089875861
Aug 04 13:15:26.508813 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:26.508725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c" event={"ID":"198fada6-9416-47cf-922f-1211dc553a9b","Type":"ContainerStarted","Data":"d75f2b0790c37815fd08967a0487c6dd9433701cd5a365d14f96a216381e33d9"}
Aug 04 13:15:26.508813 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:26.508766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c" event={"ID":"198fada6-9416-47cf-922f-1211dc553a9b","Type":"ContainerStarted","Data":"4e660203c883dc7a71f6ae968d217cf5243e3bb29c25b0ea8b2609c089875861"}
Aug 04 13:15:26.528472 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:26.528421    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c" podStartSLOduration=1.528382049 podStartE2EDuration="1.528382049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:15:26.527634603 +0000 UTC m=+2884.051509331" watchObservedRunningTime="2026-08-04 13:15:26.528382049 +0000 UTC m=+2884.052256775"
Aug 04 13:15:36.124817 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:36.124778    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:36.125345 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:36.124893    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:36.137723 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:36.137696    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:15:36.570061 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:15:36.569977    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:17:23.153726 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:17:23.153695    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:17:23.157591 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:17:23.157570    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:17:23.302052 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:17:23.302020    2574 scope.go:117] "RemoveContainer" containerID="aa29bf7674e9290e3fe7653a472c50c13196e1fe2c51f4242238cabefc686c68"
Aug 04 13:18:54.408295 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:18:54.408263    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"]
Aug 04 13:19:09.427499 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.427441    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c" podUID="198fada6-9416-47cf-922f-1211dc553a9b" containerName="main" containerID="cri-o://d75f2b0790c37815fd08967a0487c6dd9433701cd5a365d14f96a216381e33d9" gracePeriod=45
Aug 04 13:19:09.608406 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.608363    2574 generic.go:356] "Generic (PLEG): container finished" podID="198fada6-9416-47cf-922f-1211dc553a9b" containerID="d75f2b0790c37815fd08967a0487c6dd9433701cd5a365d14f96a216381e33d9" exitCode=0
Aug 04 13:19:09.608546 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.608426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c" event={"ID":"198fada6-9416-47cf-922f-1211dc553a9b","Type":"ContainerDied","Data":"d75f2b0790c37815fd08967a0487c6dd9433701cd5a365d14f96a216381e33d9"}
Aug 04 13:19:09.685920 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.685867    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:19:09.759373 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759341    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-dshm\") pod \"198fada6-9416-47cf-922f-1211dc553a9b\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") "
Aug 04 13:19:09.759561 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759411    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-tmp-dir\") pod \"198fada6-9416-47cf-922f-1211dc553a9b\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") "
Aug 04 13:19:09.759561 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759440    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-home\") pod \"198fada6-9416-47cf-922f-1211dc553a9b\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") "
Aug 04 13:19:09.759561 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759461    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86bb2\" (UniqueName: \"kubernetes.io/projected/198fada6-9416-47cf-922f-1211dc553a9b-kube-api-access-86bb2\") pod \"198fada6-9416-47cf-922f-1211dc553a9b\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") "
Aug 04 13:19:09.759561 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759488    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-model-cache\") pod \"198fada6-9416-47cf-922f-1211dc553a9b\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") "
Aug 04 13:19:09.759561 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759524    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fada6-9416-47cf-922f-1211dc553a9b-tls-certs\") pod \"198fada6-9416-47cf-922f-1211dc553a9b\" (UID: \"198fada6-9416-47cf-922f-1211dc553a9b\") "
Aug 04 13:19:09.759832 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759710    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-home" (OuterVolumeSpecName: "home") pod "198fada6-9416-47cf-922f-1211dc553a9b" (UID: "198fada6-9416-47cf-922f-1211dc553a9b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:19:09.759832 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759735    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-model-cache" (OuterVolumeSpecName: "model-cache") pod "198fada6-9416-47cf-922f-1211dc553a9b" (UID: "198fada6-9416-47cf-922f-1211dc553a9b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:19:09.759832 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.759754    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "198fada6-9416-47cf-922f-1211dc553a9b" (UID: "198fada6-9416-47cf-922f-1211dc553a9b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:19:09.761802 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.761778    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-dshm" (OuterVolumeSpecName: "dshm") pod "198fada6-9416-47cf-922f-1211dc553a9b" (UID: "198fada6-9416-47cf-922f-1211dc553a9b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:19:09.761802 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.761790    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198fada6-9416-47cf-922f-1211dc553a9b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "198fada6-9416-47cf-922f-1211dc553a9b" (UID: "198fada6-9416-47cf-922f-1211dc553a9b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:19:09.761949 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.761793    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198fada6-9416-47cf-922f-1211dc553a9b-kube-api-access-86bb2" (OuterVolumeSpecName: "kube-api-access-86bb2") pod "198fada6-9416-47cf-922f-1211dc553a9b" (UID: "198fada6-9416-47cf-922f-1211dc553a9b"). InnerVolumeSpecName "kube-api-access-86bb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:19:09.860868 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.860831    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:19:09.860868 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.860862    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:19:09.860868 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.860872    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:19:09.861162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.860881    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86bb2\" (UniqueName: \"kubernetes.io/projected/198fada6-9416-47cf-922f-1211dc553a9b-kube-api-access-86bb2\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:19:09.861162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.860890    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/198fada6-9416-47cf-922f-1211dc553a9b-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:19:09.861162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:09.860898    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/198fada6-9416-47cf-922f-1211dc553a9b-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:19:10.615162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:10.615137    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"
Aug 04 13:19:10.615592 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:10.615135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c" event={"ID":"198fada6-9416-47cf-922f-1211dc553a9b","Type":"ContainerDied","Data":"4e660203c883dc7a71f6ae968d217cf5243e3bb29c25b0ea8b2609c089875861"}
Aug 04 13:19:10.615592 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:10.615261    2574 scope.go:117] "RemoveContainer" containerID="d75f2b0790c37815fd08967a0487c6dd9433701cd5a365d14f96a216381e33d9"
Aug 04 13:19:10.641289 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:10.641262    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"]
Aug 04 13:19:10.646065 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:10.646041    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/auth-test-model-6a00c1-kserve-6c754584ff-8q92c"]
Aug 04 13:19:10.973242 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:10.973163    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198fada6-9416-47cf-922f-1211dc553a9b" path="/var/lib/kubelet/pods/198fada6-9416-47cf-922f-1211dc553a9b/volumes"
Aug 04 13:19:15.254936 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.254899    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"]
Aug 04 13:19:15.255426 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.255313    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198fada6-9416-47cf-922f-1211dc553a9b" containerName="main"
Aug 04 13:19:15.255426 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.255327    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="198fada6-9416-47cf-922f-1211dc553a9b" containerName="main"
Aug 04 13:19:15.255426 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.255381    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="198fada6-9416-47cf-922f-1211dc553a9b" containerName="main"
Aug 04 13:19:15.260009 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.259989    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.263268 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.263233    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"openshift-service-ca.crt\""
Aug 04 13:19:15.263268 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.263265    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"kube-root-ca.crt\""
Aug 04 13:19:15.264566 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.264540    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"sub-test-model-6a00c1-kserve-self-signed-certs\""
Aug 04 13:19:15.264682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.264668    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"default-dockercfg-st5jw\""
Aug 04 13:19:15.272992 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.272968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"]
Aug 04 13:19:15.408744 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.408704    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-tmp-dir\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.408744 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.408761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-model-cache\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.409003 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.408832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd3acf04-0e76-4743-89be-8fa49c5867a8-tls-certs\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.409003 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.408938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-dshm\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.409003 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.408959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48lm\" (UniqueName: \"kubernetes.io/projected/cd3acf04-0e76-4743-89be-8fa49c5867a8-kube-api-access-j48lm\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.409003 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.408977    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-home\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510363 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-dshm\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510363 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j48lm\" (UniqueName: \"kubernetes.io/projected/cd3acf04-0e76-4743-89be-8fa49c5867a8-kube-api-access-j48lm\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510363 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-home\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510363 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-tmp-dir\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510715 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-model-cache\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510715 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd3acf04-0e76-4743-89be-8fa49c5867a8-tls-certs\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510855    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-home\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510954 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-tmp-dir\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.510954 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.510923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-model-cache\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.512857 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.512838    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-dshm\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.513067 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.513049    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd3acf04-0e76-4743-89be-8fa49c5867a8-tls-certs\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.520862 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.520841    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48lm\" (UniqueName: \"kubernetes.io/projected/cd3acf04-0e76-4743-89be-8fa49c5867a8-kube-api-access-j48lm\") pod \"sub-test-model-6a00c1-kserve-5c59954d77-szm9k\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") " pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.571056 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.571017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:15.718618 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:15.718592    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"]
Aug 04 13:19:15.720468 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:19:15.720441    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd3acf04_0e76_4743_89be_8fa49c5867a8.slice/crio-b790e0fcc126cd31f5be7993657d72d42fe8f0eb728fc538ebccc82d992462b4 WatchSource:0}: Error finding container b790e0fcc126cd31f5be7993657d72d42fe8f0eb728fc538ebccc82d992462b4: Status 404 returned error can't find the container with id b790e0fcc126cd31f5be7993657d72d42fe8f0eb728fc538ebccc82d992462b4
Aug 04 13:19:16.648215 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:16.648179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k" event={"ID":"cd3acf04-0e76-4743-89be-8fa49c5867a8","Type":"ContainerStarted","Data":"72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc"}
Aug 04 13:19:16.648215 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:16.648220    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k" event={"ID":"cd3acf04-0e76-4743-89be-8fa49c5867a8","Type":"ContainerStarted","Data":"b790e0fcc126cd31f5be7993657d72d42fe8f0eb728fc538ebccc82d992462b4"}
Aug 04 13:19:16.670055 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:16.670002    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k" podStartSLOduration=1.669983335 podStartE2EDuration="1.669983335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:19:16.669108427 +0000 UTC m=+3114.192983164" watchObservedRunningTime="2026-08-04 13:19:16.669983335 +0000 UTC m=+3114.193858249"
Aug 04 13:19:25.571384 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:25.571349    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:25.571933 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:25.571426    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:25.583895 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:25.583871    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:25.701066 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:25.701037    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:19:41.581096 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.581043    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"]
Aug 04 13:19:41.585455 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.585431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.589529 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.589507    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"default-dockercfg-gltvg\""
Aug 04 13:19:41.589650 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.589529    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"sub-test-model-c1c995-kserve-self-signed-certs\""
Aug 04 13:19:41.589721 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.589673    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"openshift-service-ca.crt\""
Aug 04 13:19:41.589784 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.589729    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"kube-root-ca.crt\""
Aug 04 13:19:41.592962 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.592936    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"]
Aug 04 13:19:41.644333 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.644298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9zx7\" (UniqueName: \"kubernetes.io/projected/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-kube-api-access-k9zx7\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.644333 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.644348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-home\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.644596 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.644373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tls-certs\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.644596 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.644520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-model-cache\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.644596 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.644549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tmp-dir\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.644596 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.644586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-dshm\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.746062 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9zx7\" (UniqueName: \"kubernetes.io/projected/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-kube-api-access-k9zx7\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.746351 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-home\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.746546 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tls-certs\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.746546 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-model-cache\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.746546 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tmp-dir\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.746708 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746597    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-dshm\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.747331 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.746798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-home\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.747331 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.747024    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-model-cache\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.747331 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.747069    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tmp-dir\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.749304 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.749276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-dshm\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.749731 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.749715    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tls-certs\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.757069 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.757043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9zx7\" (UniqueName: \"kubernetes.io/projected/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-kube-api-access-k9zx7\") pod \"sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") " pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:41.896502 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:41.896470    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:42.037438 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:42.037405    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"]
Aug 04 13:19:42.037899 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:19:42.037870    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1dd07f0_8c6d_4b49_a8f8_890cd482e496.slice/crio-f3db4a0c18197710fb0ef326c57154d346ff159bec9552c826d55c4f90bda279 WatchSource:0}: Error finding container f3db4a0c18197710fb0ef326c57154d346ff159bec9552c826d55c4f90bda279: Status 404 returned error can't find the container with id f3db4a0c18197710fb0ef326c57154d346ff159bec9552c826d55c4f90bda279
Aug 04 13:19:42.774036 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:42.773995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs" event={"ID":"c1dd07f0-8c6d-4b49-a8f8-890cd482e496","Type":"ContainerStarted","Data":"5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9"}
Aug 04 13:19:42.774036 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:42.774039    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs" event={"ID":"c1dd07f0-8c6d-4b49-a8f8-890cd482e496","Type":"ContainerStarted","Data":"f3db4a0c18197710fb0ef326c57154d346ff159bec9552c826d55c4f90bda279"}
Aug 04 13:19:42.794578 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:42.794522    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs" podStartSLOduration=1.7945024250000001 podStartE2EDuration="1.794502425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:19:42.794344385 +0000 UTC m=+3140.318219125" watchObservedRunningTime="2026-08-04 13:19:42.794502425 +0000 UTC m=+3140.318377154"
Aug 04 13:19:51.897050 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:51.896962    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:51.897050 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:51.897004    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:51.909501 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:51.909481    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:19:52.835813 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:19:52.835786    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:21:06.498213 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:06.498176    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"]
Aug 04 13:21:07.520278 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:07.520249    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"]
Aug 04 13:21:21.517287 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.517237    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k" podUID="cd3acf04-0e76-4743-89be-8fa49c5867a8" containerName="main" containerID="cri-o://72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc" gracePeriod=45
Aug 04 13:21:21.768829 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.768771    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:21:21.873265 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873230    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-tmp-dir\") pod \"cd3acf04-0e76-4743-89be-8fa49c5867a8\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") "
Aug 04 13:21:21.873265 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873266    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-dshm\") pod \"cd3acf04-0e76-4743-89be-8fa49c5867a8\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") "
Aug 04 13:21:21.873736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873301    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-model-cache\") pod \"cd3acf04-0e76-4743-89be-8fa49c5867a8\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") "
Aug 04 13:21:21.873736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873331    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd3acf04-0e76-4743-89be-8fa49c5867a8-tls-certs\") pod \"cd3acf04-0e76-4743-89be-8fa49c5867a8\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") "
Aug 04 13:21:21.873736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873363    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j48lm\" (UniqueName: \"kubernetes.io/projected/cd3acf04-0e76-4743-89be-8fa49c5867a8-kube-api-access-j48lm\") pod \"cd3acf04-0e76-4743-89be-8fa49c5867a8\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") "
Aug 04 13:21:21.873736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873483    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-home\") pod \"cd3acf04-0e76-4743-89be-8fa49c5867a8\" (UID: \"cd3acf04-0e76-4743-89be-8fa49c5867a8\") "
Aug 04 13:21:21.873736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873621    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd3acf04-0e76-4743-89be-8fa49c5867a8" (UID: "cd3acf04-0e76-4743-89be-8fa49c5867a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:21.873736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873634    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd3acf04-0e76-4743-89be-8fa49c5867a8" (UID: "cd3acf04-0e76-4743-89be-8fa49c5867a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:21.874014 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873868    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-home" (OuterVolumeSpecName: "home") pod "cd3acf04-0e76-4743-89be-8fa49c5867a8" (UID: "cd3acf04-0e76-4743-89be-8fa49c5867a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:21.874014 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873925    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:21.874014 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.873948    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:21.875735 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.875698    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd3acf04-0e76-4743-89be-8fa49c5867a8-kube-api-access-j48lm" (OuterVolumeSpecName: "kube-api-access-j48lm") pod "cd3acf04-0e76-4743-89be-8fa49c5867a8" (UID: "cd3acf04-0e76-4743-89be-8fa49c5867a8"). InnerVolumeSpecName "kube-api-access-j48lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:21:21.875842 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.875742    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-dshm" (OuterVolumeSpecName: "dshm") pod "cd3acf04-0e76-4743-89be-8fa49c5867a8" (UID: "cd3acf04-0e76-4743-89be-8fa49c5867a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:21.875842 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.875756    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd3acf04-0e76-4743-89be-8fa49c5867a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd3acf04-0e76-4743-89be-8fa49c5867a8" (UID: "cd3acf04-0e76-4743-89be-8fa49c5867a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:21:21.974990 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.974951    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:21.974990 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.974984    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd3acf04-0e76-4743-89be-8fa49c5867a8-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:21.974990 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.974997    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd3acf04-0e76-4743-89be-8fa49c5867a8-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:21.975221 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:21.975010    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j48lm\" (UniqueName: \"kubernetes.io/projected/cd3acf04-0e76-4743-89be-8fa49c5867a8-kube-api-access-j48lm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:22.268130 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.268094    2574 generic.go:356] "Generic (PLEG): container finished" podID="cd3acf04-0e76-4743-89be-8fa49c5867a8" containerID="72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc" exitCode=0
Aug 04 13:21:22.268306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.268138    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"
Aug 04 13:21:22.268306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.268191    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k" event={"ID":"cd3acf04-0e76-4743-89be-8fa49c5867a8","Type":"ContainerDied","Data":"72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc"}
Aug 04 13:21:22.268306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.268233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k" event={"ID":"cd3acf04-0e76-4743-89be-8fa49c5867a8","Type":"ContainerDied","Data":"b790e0fcc126cd31f5be7993657d72d42fe8f0eb728fc538ebccc82d992462b4"}
Aug 04 13:21:22.268306 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.268249    2574 scope.go:117] "RemoveContainer" containerID="72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc"
Aug 04 13:21:22.277292 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.277272    2574 scope.go:117] "RemoveContainer" containerID="72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc"
Aug 04 13:21:22.277595 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:21:22.277575    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc\": container with ID starting with 72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc not found: ID does not exist" containerID="72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc"
Aug 04 13:21:22.277650 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.277605    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc"} err="failed to get container status \"72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc\": rpc error: code = NotFound desc = could not find container \"72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc\": container with ID starting with 72f7997c3ab682990468fbbf38562477088e0bdcf8488889b6a565cf221f79bc not found: ID does not exist"
Aug 04 13:21:22.292699 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.292670    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"]
Aug 04 13:21:22.300406 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.300368    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/sub-test-model-6a00c1-kserve-5c59954d77-szm9k"]
Aug 04 13:21:22.541958 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.541863    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs" podUID="c1dd07f0-8c6d-4b49-a8f8-890cd482e496" containerName="main" containerID="cri-o://5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9" gracePeriod=45
Aug 04 13:21:22.790197 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.790171    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:21:22.883677 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883644    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-home\") pod \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") "
Aug 04 13:21:22.883677 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883675    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tmp-dir\") pod \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") "
Aug 04 13:21:22.883938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883701    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tls-certs\") pod \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") "
Aug 04 13:21:22.883938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883722    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-model-cache\") pod \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") "
Aug 04 13:21:22.883938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883735    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-dshm\") pod \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") "
Aug 04 13:21:22.883938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883867    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9zx7\" (UniqueName: \"kubernetes.io/projected/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-kube-api-access-k9zx7\") pod \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\" (UID: \"c1dd07f0-8c6d-4b49-a8f8-890cd482e496\") "
Aug 04 13:21:22.883938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883925    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1dd07f0-8c6d-4b49-a8f8-890cd482e496" (UID: "c1dd07f0-8c6d-4b49-a8f8-890cd482e496"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:22.884186 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883940    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-home" (OuterVolumeSpecName: "home") pod "c1dd07f0-8c6d-4b49-a8f8-890cd482e496" (UID: "c1dd07f0-8c6d-4b49-a8f8-890cd482e496"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:22.884186 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.883952    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1dd07f0-8c6d-4b49-a8f8-890cd482e496" (UID: "c1dd07f0-8c6d-4b49-a8f8-890cd482e496"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:22.884186 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.884095    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:22.884186 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.884110    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:22.884186 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.884121    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:22.886211 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.886186    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-kube-api-access-k9zx7" (OuterVolumeSpecName: "kube-api-access-k9zx7") pod "c1dd07f0-8c6d-4b49-a8f8-890cd482e496" (UID: "c1dd07f0-8c6d-4b49-a8f8-890cd482e496"). InnerVolumeSpecName "kube-api-access-k9zx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:21:22.886211 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.886199    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1dd07f0-8c6d-4b49-a8f8-890cd482e496" (UID: "c1dd07f0-8c6d-4b49-a8f8-890cd482e496"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:21:22.886211 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.886203    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-dshm" (OuterVolumeSpecName: "dshm") pod "c1dd07f0-8c6d-4b49-a8f8-890cd482e496" (UID: "c1dd07f0-8c6d-4b49-a8f8-890cd482e496"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:21:22.973049 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.973014    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd3acf04-0e76-4743-89be-8fa49c5867a8" path="/var/lib/kubelet/pods/cd3acf04-0e76-4743-89be-8fa49c5867a8/volumes"
Aug 04 13:21:22.985312 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.985289    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9zx7\" (UniqueName: \"kubernetes.io/projected/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-kube-api-access-k9zx7\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:22.985312 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.985313    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:22.985491 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:22.985322    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1dd07f0-8c6d-4b49-a8f8-890cd482e496-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:21:23.275410 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.275307    2574 generic.go:356] "Generic (PLEG): container finished" podID="c1dd07f0-8c6d-4b49-a8f8-890cd482e496" containerID="5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9" exitCode=0
Aug 04 13:21:23.275410 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.275355    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"
Aug 04 13:21:23.275653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.275347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs" event={"ID":"c1dd07f0-8c6d-4b49-a8f8-890cd482e496","Type":"ContainerDied","Data":"5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9"}
Aug 04 13:21:23.275653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.275477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs" event={"ID":"c1dd07f0-8c6d-4b49-a8f8-890cd482e496","Type":"ContainerDied","Data":"f3db4a0c18197710fb0ef326c57154d346ff159bec9552c826d55c4f90bda279"}
Aug 04 13:21:23.275653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.275501    2574 scope.go:117] "RemoveContainer" containerID="5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9"
Aug 04 13:21:23.283814 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.283798    2574 scope.go:117] "RemoveContainer" containerID="5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9"
Aug 04 13:21:23.284068 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:21:23.284046    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9\": container with ID starting with 5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9 not found: ID does not exist" containerID="5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9"
Aug 04 13:21:23.284134 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.284078    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9"} err="failed to get container status \"5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9\": rpc error: code = NotFound desc = could not find container \"5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9\": container with ID starting with 5a75cc2bd379ad39b9ee29cd64c06f303cbff231d9a62aa69d748dabdd3728f9 not found: ID does not exist"
Aug 04 13:21:23.298819 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.298773    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"]
Aug 04 13:21:23.301016 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:23.300989    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/sub-test-model-c1c995-kserve-6c48bf6b7-rrbfs"]
Aug 04 13:21:24.972938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:24.972906    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1dd07f0-8c6d-4b49-a8f8-890cd482e496" path="/var/lib/kubelet/pods/c1dd07f0-8c6d-4b49-a8f8-890cd482e496/volumes"
Aug 04 13:21:29.410507 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410477    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"]
Aug 04 13:21:29.410880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410853    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd3acf04-0e76-4743-89be-8fa49c5867a8" containerName="main"
Aug 04 13:21:29.410880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410865    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd3acf04-0e76-4743-89be-8fa49c5867a8" containerName="main"
Aug 04 13:21:29.410948 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410883    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1dd07f0-8c6d-4b49-a8f8-890cd482e496" containerName="main"
Aug 04 13:21:29.410948 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410889    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1dd07f0-8c6d-4b49-a8f8-890cd482e496" containerName="main"
Aug 04 13:21:29.411010 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410947    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd3acf04-0e76-4743-89be-8fa49c5867a8" containerName="main"
Aug 04 13:21:29.411010 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.410960    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1dd07f0-8c6d-4b49-a8f8-890cd482e496" containerName="main"
Aug 04 13:21:29.415275 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.415258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.419372 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.419348    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"rate-test-model-6a00c1-kserve-self-signed-certs\""
Aug 04 13:21:29.419372 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.419369    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"kube-root-ca.crt\""
Aug 04 13:21:29.419580 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.419370    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"openshift-service-ca.crt\""
Aug 04 13:21:29.419580 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.419369    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a00c1\"/\"default-dockercfg-st5jw\""
Aug 04 13:21:29.423254 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.423232    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"]
Aug 04 13:21:29.547712 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.547680    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-dshm\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.547858 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.547735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-model-cache\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.547858 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.547808    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-home\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.547858 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.547850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzqp\" (UniqueName: \"kubernetes.io/projected/64888c26-ae9b-4fb1-9954-2e5191752f04-kube-api-access-nrzqp\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.547995 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.547890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-tmp-dir\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.547995 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.547943    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64888c26-ae9b-4fb1-9954-2e5191752f04-tls-certs\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649089 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-tmp-dir\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649264 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64888c26-ae9b-4fb1-9954-2e5191752f04-tls-certs\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649264 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-dshm\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649264 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-model-cache\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649264 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-home\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649264 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzqp\" (UniqueName: \"kubernetes.io/projected/64888c26-ae9b-4fb1-9954-2e5191752f04-kube-api-access-nrzqp\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649586 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-model-cache\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649654 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-tmp-dir\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.649654 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.649604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-home\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.652276 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.652247    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-dshm\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.652448 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.652345    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64888c26-ae9b-4fb1-9954-2e5191752f04-tls-certs\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.659938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.659909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzqp\" (UniqueName: \"kubernetes.io/projected/64888c26-ae9b-4fb1-9954-2e5191752f04-kube-api-access-nrzqp\") pod \"rate-test-model-6a00c1-kserve-897bf8d55-5kdk4\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") " pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.726007 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.725934    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:29.864629 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:29.864598    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"]
Aug 04 13:21:29.866493 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:21:29.866452    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64888c26_ae9b_4fb1_9954_2e5191752f04.slice/crio-076bcae514994efa3627f2dec4b77c0c4736e6e7bc1d57b0bad36a6541bc533f WatchSource:0}: Error finding container 076bcae514994efa3627f2dec4b77c0c4736e6e7bc1d57b0bad36a6541bc533f: Status 404 returned error can't find the container with id 076bcae514994efa3627f2dec4b77c0c4736e6e7bc1d57b0bad36a6541bc533f
Aug 04 13:21:30.307350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:30.307304    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4" event={"ID":"64888c26-ae9b-4fb1-9954-2e5191752f04","Type":"ContainerStarted","Data":"c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752"}
Aug 04 13:21:30.307350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:30.307351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4" event={"ID":"64888c26-ae9b-4fb1-9954-2e5191752f04","Type":"ContainerStarted","Data":"076bcae514994efa3627f2dec4b77c0c4736e6e7bc1d57b0bad36a6541bc533f"}
Aug 04 13:21:30.328012 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:30.327962    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4" podStartSLOduration=1.327943936 podStartE2EDuration="1.327943936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:21:30.32722427 +0000 UTC m=+3247.851098998" watchObservedRunningTime="2026-08-04 13:21:30.327943936 +0000 UTC m=+3247.851818664"
Aug 04 13:21:39.726305 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:39.726255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:39.726952 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:39.726318    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:39.739016 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:39.738991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:21:40.369335 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:21:40.369305    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:22:04.543538 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.543500    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"]
Aug 04 13:22:04.546860 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.546839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.555721 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.555694    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"rate-test-model-c1c995-kserve-self-signed-certs\""
Aug 04 13:22:04.555871 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.555796    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"openshift-service-ca.crt\""
Aug 04 13:22:04.556060 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.556037    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"default-dockercfg-gltvg\""
Aug 04 13:22:04.556194 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.556063    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c1c995\"/\"kube-root-ca.crt\""
Aug 04 13:22:04.562697 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.562672    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"]
Aug 04 13:22:04.657692 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.657659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkxc4\" (UniqueName: \"kubernetes.io/projected/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-kube-api-access-hkxc4\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.657859 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.657722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-home\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.657859 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.657750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tls-certs\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.657859 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.657795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-dshm\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.657859 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.657810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-model-cache\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.657859 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.657830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tmp-dir\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.758999 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.758962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkxc4\" (UniqueName: \"kubernetes.io/projected/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-kube-api-access-hkxc4\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759012    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-home\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tls-certs\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-dshm\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759093    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-model-cache\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tmp-dir\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759578    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-home\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759680 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-model-cache\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.759680 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.759639    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tmp-dir\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.761495 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.761466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-dshm\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.761827 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.761806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tls-certs\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.770289 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.770268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkxc4\" (UniqueName: \"kubernetes.io/projected/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-kube-api-access-hkxc4\") pod \"rate-test-model-c1c995-kserve-c69c7464c-xk6rg\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") " pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:04.857586 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:04.857542    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:05.001874 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:05.001848    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"]
Aug 04 13:22:05.003846 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:22:05.003820    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod220955b5_4786_4ab9_9ee5_fdf20a81e7e7.slice/crio-7ab2679c4e441a3ce9a32063e172579bb5dde6fc48c0783076240bc87f7db072 WatchSource:0}: Error finding container 7ab2679c4e441a3ce9a32063e172579bb5dde6fc48c0783076240bc87f7db072: Status 404 returned error can't find the container with id 7ab2679c4e441a3ce9a32063e172579bb5dde6fc48c0783076240bc87f7db072
Aug 04 13:22:05.486712 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:05.486672    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg" event={"ID":"220955b5-4786-4ab9-9ee5-fdf20a81e7e7","Type":"ContainerStarted","Data":"6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5"}
Aug 04 13:22:05.486886 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:05.486720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg" event={"ID":"220955b5-4786-4ab9-9ee5-fdf20a81e7e7","Type":"ContainerStarted","Data":"7ab2679c4e441a3ce9a32063e172579bb5dde6fc48c0783076240bc87f7db072"}
Aug 04 13:22:05.522266 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:05.522209    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg" podStartSLOduration=1.522191412 podStartE2EDuration="1.522191412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:22:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:22:05.519658123 +0000 UTC m=+3283.043532859" watchObservedRunningTime="2026-08-04 13:22:05.522191412 +0000 UTC m=+3283.046066139"
Aug 04 13:22:14.858823 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:14.858777    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:14.859498 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:14.858843    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:14.871301 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:14.871272    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:15.551708 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:15.551677    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:22:23.185017 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:23.184986    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:22:23.190290 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:22:23.190267    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:23:15.515230 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:15.515145    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"]
Aug 04 13:23:16.487822 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:16.487785    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"]
Aug 04 13:23:30.536243 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.536182    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4" podUID="64888c26-ae9b-4fb1-9954-2e5191752f04" containerName="main" containerID="cri-o://c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752" gracePeriod=45
Aug 04 13:23:30.778634 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.778609    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:23:30.854540 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854511    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-tmp-dir\") pod \"64888c26-ae9b-4fb1-9954-2e5191752f04\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") "
Aug 04 13:23:30.854540 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854555    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-home\") pod \"64888c26-ae9b-4fb1-9954-2e5191752f04\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") "
Aug 04 13:23:30.854799 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854594    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64888c26-ae9b-4fb1-9954-2e5191752f04-tls-certs\") pod \"64888c26-ae9b-4fb1-9954-2e5191752f04\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") "
Aug 04 13:23:30.854799 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854612    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-dshm\") pod \"64888c26-ae9b-4fb1-9954-2e5191752f04\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") "
Aug 04 13:23:30.854799 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854646    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-model-cache\") pod \"64888c26-ae9b-4fb1-9954-2e5191752f04\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") "
Aug 04 13:23:30.854799 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854710    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrzqp\" (UniqueName: \"kubernetes.io/projected/64888c26-ae9b-4fb1-9954-2e5191752f04-kube-api-access-nrzqp\") pod \"64888c26-ae9b-4fb1-9954-2e5191752f04\" (UID: \"64888c26-ae9b-4fb1-9954-2e5191752f04\") "
Aug 04 13:23:30.855012 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854900    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64888c26-ae9b-4fb1-9954-2e5191752f04" (UID: "64888c26-ae9b-4fb1-9954-2e5191752f04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:30.855012 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854925    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-home" (OuterVolumeSpecName: "home") pod "64888c26-ae9b-4fb1-9954-2e5191752f04" (UID: "64888c26-ae9b-4fb1-9954-2e5191752f04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:30.855012 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.854996    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-model-cache" (OuterVolumeSpecName: "model-cache") pod "64888c26-ae9b-4fb1-9954-2e5191752f04" (UID: "64888c26-ae9b-4fb1-9954-2e5191752f04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:30.856998 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.856970    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64888c26-ae9b-4fb1-9954-2e5191752f04-kube-api-access-nrzqp" (OuterVolumeSpecName: "kube-api-access-nrzqp") pod "64888c26-ae9b-4fb1-9954-2e5191752f04" (UID: "64888c26-ae9b-4fb1-9954-2e5191752f04"). InnerVolumeSpecName "kube-api-access-nrzqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:23:30.857112 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.856973    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-dshm" (OuterVolumeSpecName: "dshm") pod "64888c26-ae9b-4fb1-9954-2e5191752f04" (UID: "64888c26-ae9b-4fb1-9954-2e5191752f04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:30.857112 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.857045    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64888c26-ae9b-4fb1-9954-2e5191752f04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64888c26-ae9b-4fb1-9954-2e5191752f04" (UID: "64888c26-ae9b-4fb1-9954-2e5191752f04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:23:30.917224 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.917188    2574 generic.go:356] "Generic (PLEG): container finished" podID="64888c26-ae9b-4fb1-9954-2e5191752f04" containerID="c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752" exitCode=0
Aug 04 13:23:30.917474 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.917232    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"
Aug 04 13:23:30.917474 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.917274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4" event={"ID":"64888c26-ae9b-4fb1-9954-2e5191752f04","Type":"ContainerDied","Data":"c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752"}
Aug 04 13:23:30.917474 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.917318    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4" event={"ID":"64888c26-ae9b-4fb1-9954-2e5191752f04","Type":"ContainerDied","Data":"076bcae514994efa3627f2dec4b77c0c4736e6e7bc1d57b0bad36a6541bc533f"}
Aug 04 13:23:30.917474 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.917335    2574 scope.go:117] "RemoveContainer" containerID="c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752"
Aug 04 13:23:30.926411 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.926371    2574 scope.go:117] "RemoveContainer" containerID="c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752"
Aug 04 13:23:30.926713 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:23:30.926694    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752\": container with ID starting with c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752 not found: ID does not exist" containerID="c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752"
Aug 04 13:23:30.926777 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.926724    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752"} err="failed to get container status \"c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752\": rpc error: code = NotFound desc = could not find container \"c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752\": container with ID starting with c3c598976c220a6ff7d6e58fcd49a4caa301cf5dc69cb327864ccece45534752 not found: ID does not exist"
Aug 04 13:23:30.941454 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.941427    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"]
Aug 04 13:23:30.948682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.948654    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a00c1/rate-test-model-6a00c1-kserve-897bf8d55-5kdk4"]
Aug 04 13:23:30.955265 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.955246    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:30.955337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.955267    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:30.955337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.955277    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrzqp\" (UniqueName: \"kubernetes.io/projected/64888c26-ae9b-4fb1-9954-2e5191752f04-kube-api-access-nrzqp\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:30.955337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.955305    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:30.955337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.955316    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64888c26-ae9b-4fb1-9954-2e5191752f04-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:30.955337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.955324    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64888c26-ae9b-4fb1-9954-2e5191752f04-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:30.972441 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:30.972408    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64888c26-ae9b-4fb1-9954-2e5191752f04" path="/var/lib/kubelet/pods/64888c26-ae9b-4fb1-9954-2e5191752f04/volumes"
Aug 04 13:23:31.507225 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.507182    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg" podUID="220955b5-4786-4ab9-9ee5-fdf20a81e7e7" containerName="main" containerID="cri-o://6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5" gracePeriod=45
Aug 04 13:23:31.753526 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.753503    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:23:31.760127 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760074    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-model-cache\") pod \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") "
Aug 04 13:23:31.760127 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760123    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-dshm\") pod \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") "
Aug 04 13:23:31.760296 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760196    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkxc4\" (UniqueName: \"kubernetes.io/projected/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-kube-api-access-hkxc4\") pod \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") "
Aug 04 13:23:31.760296 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760215    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tmp-dir\") pod \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") "
Aug 04 13:23:31.760296 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760244    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-home\") pod \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") "
Aug 04 13:23:31.760484 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760321    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tls-certs\") pod \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\" (UID: \"220955b5-4786-4ab9-9ee5-fdf20a81e7e7\") "
Aug 04 13:23:31.760484 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760452    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-model-cache" (OuterVolumeSpecName: "model-cache") pod "220955b5-4786-4ab9-9ee5-fdf20a81e7e7" (UID: "220955b5-4786-4ab9-9ee5-fdf20a81e7e7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:31.760575 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760502    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-home" (OuterVolumeSpecName: "home") pod "220955b5-4786-4ab9-9ee5-fdf20a81e7e7" (UID: "220955b5-4786-4ab9-9ee5-fdf20a81e7e7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:31.760575 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760525    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "220955b5-4786-4ab9-9ee5-fdf20a81e7e7" (UID: "220955b5-4786-4ab9-9ee5-fdf20a81e7e7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:31.760724 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760705    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:31.760862 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760729    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:31.760862 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.760742    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:31.762449 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.762418    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-kube-api-access-hkxc4" (OuterVolumeSpecName: "kube-api-access-hkxc4") pod "220955b5-4786-4ab9-9ee5-fdf20a81e7e7" (UID: "220955b5-4786-4ab9-9ee5-fdf20a81e7e7"). InnerVolumeSpecName "kube-api-access-hkxc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:23:31.762544 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.762479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "220955b5-4786-4ab9-9ee5-fdf20a81e7e7" (UID: "220955b5-4786-4ab9-9ee5-fdf20a81e7e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:23:31.762544 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.762527    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-dshm" (OuterVolumeSpecName: "dshm") pod "220955b5-4786-4ab9-9ee5-fdf20a81e7e7" (UID: "220955b5-4786-4ab9-9ee5-fdf20a81e7e7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:23:31.861986 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.861946    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkxc4\" (UniqueName: \"kubernetes.io/projected/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-kube-api-access-hkxc4\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:31.861986 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.861980    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:31.861986 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.861989    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/220955b5-4786-4ab9-9ee5-fdf20a81e7e7-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:31.930564 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.930522    2574 generic.go:356] "Generic (PLEG): container finished" podID="220955b5-4786-4ab9-9ee5-fdf20a81e7e7" containerID="6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5" exitCode=0
Aug 04 13:23:31.930741 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.930574    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"
Aug 04 13:23:31.930741 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.930605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg" event={"ID":"220955b5-4786-4ab9-9ee5-fdf20a81e7e7","Type":"ContainerDied","Data":"6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5"}
Aug 04 13:23:31.930741 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.930648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg" event={"ID":"220955b5-4786-4ab9-9ee5-fdf20a81e7e7","Type":"ContainerDied","Data":"7ab2679c4e441a3ce9a32063e172579bb5dde6fc48c0783076240bc87f7db072"}
Aug 04 13:23:31.930741 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.930672    2574 scope.go:117] "RemoveContainer" containerID="6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5"
Aug 04 13:23:31.939714 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.939689    2574 scope.go:117] "RemoveContainer" containerID="6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5"
Aug 04 13:23:31.939992 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:23:31.939970    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5\": container with ID starting with 6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5 not found: ID does not exist" containerID="6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5"
Aug 04 13:23:31.940057 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.940000    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5"} err="failed to get container status \"6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5\": rpc error: code = NotFound desc = could not find container \"6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5\": container with ID starting with 6f8e6d620382337f962dae8227dc2011993b042b3a7a8b454ba6158729b383c5 not found: ID does not exist"
Aug 04 13:23:31.954274 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.954243    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"]
Aug 04 13:23:31.958162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:31.958137    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c1c995/rate-test-model-c1c995-kserve-c69c7464c-xk6rg"]
Aug 04 13:23:32.763246 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763209    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7696-140604917805392"]
Aug 04 13:23:32.763682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763589    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="220955b5-4786-4ab9-9ee5-fdf20a81e7e7" containerName="main"
Aug 04 13:23:32.763682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763600    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="220955b5-4786-4ab9-9ee5-fdf20a81e7e7" containerName="main"
Aug 04 13:23:32.763682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763623    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64888c26-ae9b-4fb1-9954-2e5191752f04" containerName="main"
Aug 04 13:23:32.763682 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763629    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="64888c26-ae9b-4fb1-9954-2e5191752f04" containerName="main"
Aug 04 13:23:32.763812 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763687    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="64888c26-ae9b-4fb1-9954-2e5191752f04" containerName="main"
Aug 04 13:23:32.763812 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.763698    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="220955b5-4786-4ab9-9ee5-fdf20a81e7e7" containerName="main"
Aug 04 13:23:32.768088 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.768068    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:32.771384 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.771364    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l88d\""
Aug 04 13:23:32.774307 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.774284    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-140604917805392"]
Aug 04 13:23:32.869895 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.869853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pp8x\" (UniqueName: \"kubernetes.io/projected/3db52147-2850-469c-b7e7-3644d3bccd42-kube-api-access-2pp8x\") pod \"test-curl-7696-140604917805392\" (UID: \"3db52147-2850-469c-b7e7-3644d3bccd42\") " pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:32.970621 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.970580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pp8x\" (UniqueName: \"kubernetes.io/projected/3db52147-2850-469c-b7e7-3644d3bccd42-kube-api-access-2pp8x\") pod \"test-curl-7696-140604917805392\" (UID: \"3db52147-2850-469c-b7e7-3644d3bccd42\") " pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:32.972473 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.972450    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="220955b5-4786-4ab9-9ee5-fdf20a81e7e7" path="/var/lib/kubelet/pods/220955b5-4786-4ab9-9ee5-fdf20a81e7e7/volumes"
Aug 04 13:23:32.981202 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:32.981180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pp8x\" (UniqueName: \"kubernetes.io/projected/3db52147-2850-469c-b7e7-3644d3bccd42-kube-api-access-2pp8x\") pod \"test-curl-7696-140604917805392\" (UID: \"3db52147-2850-469c-b7e7-3644d3bccd42\") " pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:33.079355 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:33.079262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:33.215460 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:33.215378    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7696-140604917805392"]
Aug 04 13:23:33.217579 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:23:33.217550    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3db52147_2850_469c_b7e7_3644d3bccd42.slice/crio-b11b3f8f8916c26b9b39379547898f517d9b21485de023e29310e4a7b724117d WatchSource:0}: Error finding container b11b3f8f8916c26b9b39379547898f517d9b21485de023e29310e4a7b724117d: Status 404 returned error can't find the container with id b11b3f8f8916c26b9b39379547898f517d9b21485de023e29310e4a7b724117d
Aug 04 13:23:33.218784 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:33.218764    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 13:23:33.944809 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:33.944778    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-140604917805392" event={"ID":"3db52147-2850-469c-b7e7-3644d3bccd42","Type":"ContainerStarted","Data":"b11b3f8f8916c26b9b39379547898f517d9b21485de023e29310e4a7b724117d"}
Aug 04 13:23:34.950839 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:34.950798    2574 generic.go:356] "Generic (PLEG): container finished" podID="3db52147-2850-469c-b7e7-3644d3bccd42" containerID="92c0ab7bd6f9c16c2f949f1b8e8267e008741da5b24d23bdbe3afbbc3e3173fe" exitCode=0
Aug 04 13:23:34.951232 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:34.950891    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7696-140604917805392" event={"ID":"3db52147-2850-469c-b7e7-3644d3bccd42","Type":"ContainerDied","Data":"92c0ab7bd6f9c16c2f949f1b8e8267e008741da5b24d23bdbe3afbbc3e3173fe"}
Aug 04 13:23:36.102805 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.102782    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:36.138072 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.138045    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7696-140604917805392_3db52147-2850-469c-b7e7-3644d3bccd42/test-curl-7696-140604917805392/0.log"
Aug 04 13:23:36.159994 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.159960    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7696-140604917805392"]
Aug 04 13:23:36.164843 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.164817    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7696-140604917805392"]
Aug 04 13:23:36.198350 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.198314    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pp8x\" (UniqueName: \"kubernetes.io/projected/3db52147-2850-469c-b7e7-3644d3bccd42-kube-api-access-2pp8x\") pod \"3db52147-2850-469c-b7e7-3644d3bccd42\" (UID: \"3db52147-2850-469c-b7e7-3644d3bccd42\") "
Aug 04 13:23:36.200719 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.200689    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db52147-2850-469c-b7e7-3644d3bccd42-kube-api-access-2pp8x" (OuterVolumeSpecName: "kube-api-access-2pp8x") pod "3db52147-2850-469c-b7e7-3644d3bccd42" (UID: "3db52147-2850-469c-b7e7-3644d3bccd42"). InnerVolumeSpecName "kube-api-access-2pp8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:23:36.299255 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.299172    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pp8x\" (UniqueName: \"kubernetes.io/projected/3db52147-2850-469c-b7e7-3644d3bccd42-kube-api-access-2pp8x\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:23:36.963104 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.963064    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:36.963104 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.963089    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b11b3f8f8916c26b9b39379547898f517d9b21485de023e29310e4a7b724117d"
Aug 04 13:23:36.972107 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:36.972078    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db52147-2850-469c-b7e7-3644d3bccd42" path="/var/lib/kubelet/pods/3db52147-2850-469c-b7e7-3644d3bccd42/volumes"
Aug 04 13:23:36.973584 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:23:36.973554    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7696-140604917805392\" is forbidden: User \"system:node:ip-10-0-132-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-243.ec2.internal' and this object" podUID="3db52147-2850-469c-b7e7-3644d3bccd42" pod="opendatahub/test-curl-7696-140604917805392"
Aug 04 13:23:37.005011 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.004972    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"]
Aug 04 13:23:37.005554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.005525    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db52147-2850-469c-b7e7-3644d3bccd42" containerName="test-curl-7696-140604917805392"
Aug 04 13:23:37.005554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.005558    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db52147-2850-469c-b7e7-3644d3bccd42" containerName="test-curl-7696-140604917805392"
Aug 04 13:23:37.005655 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.005648    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db52147-2850-469c-b7e7-3644d3bccd42" containerName="test-curl-7696-140604917805392"
Aug 04 13:23:37.009094 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.009075    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.012551 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.012534    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-2ef922-openshift-default-dockercfg-qrf6l\""
Aug 04 13:23:37.020317 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.020293    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"]
Aug 04 13:23:37.105035 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmdn8\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-kube-api-access-vmdn8\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-podinfo\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istiod-ca-cert\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-socket\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105210    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-credential-socket\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-token\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-envoy\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-certs\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.105530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.105469    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-data\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206318 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-socket\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206318 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-credential-socket\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-token\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-envoy\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206427    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-certs\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-data\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmdn8\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-kube-api-access-vmdn8\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-podinfo\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.206642 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istiod-ca-cert\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.207007 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-socket\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.207007 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206862    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-credential-socket\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.207007 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.206909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-certs\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.207165 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.207084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-data\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.207229 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.207209    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istiod-ca-cert\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.208923 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.208900    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-envoy\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.209480 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.209459    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-podinfo\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.220619 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.220566    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-token\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.222236 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.222217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmdn8\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-kube-api-access-vmdn8\") pod \"e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") " pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.320888 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.320848    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:37.475177 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.475092    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"]
Aug 04 13:23:37.489462 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:23:37.489427    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81809b3_7dd0_436e_99c1_7283ff8c8c04.slice/crio-038639e46baccb1641e16f8076dddbe0f38e76c0fe4941a2687b4d3257d3d07e WatchSource:0}: Error finding container 038639e46baccb1641e16f8076dddbe0f38e76c0fe4941a2687b4d3257d3d07e: Status 404 returned error can't find the container with id 038639e46baccb1641e16f8076dddbe0f38e76c0fe4941a2687b4d3257d3d07e
Aug 04 13:23:37.491742 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.491705    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 13:23:37.491816 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.491798    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 13:23:37.491860 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.491841    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 13:23:37.969890 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.969855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" event={"ID":"b81809b3-7dd0-436e-99c1-7283ff8c8c04","Type":"ContainerStarted","Data":"3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"}
Aug 04 13:23:37.970078 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.969906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" event={"ID":"b81809b3-7dd0-436e-99c1-7283ff8c8c04","Type":"ContainerStarted","Data":"038639e46baccb1641e16f8076dddbe0f38e76c0fe4941a2687b4d3257d3d07e"}
Aug 04 13:23:37.993247 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:37.993186    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podStartSLOduration=1.993167994 podStartE2EDuration="1.993167994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:23:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:23:37.992450441 +0000 UTC m=+3375.516325169" watchObservedRunningTime="2026-08-04 13:23:37.993167994 +0000 UTC m=+3375.517042771"
Aug 04 13:23:38.321248 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:38.321140    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:38.326305 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:38.326276    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:38.977088 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:38.977055    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:38.977948 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:38.977929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:54.168832 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:54.168297    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:37966->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Aug 04 13:23:54.168832 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:54.168380    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:37966->10.133.0.67:15021: read: connection reset by peer"
Aug 04 13:23:55.072789 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:55.072750    2574 generic.go:356] "Generic (PLEG): container finished" podID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerID="3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac" exitCode=0
Aug 04 13:23:55.072976 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:55.072805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" event={"ID":"b81809b3-7dd0-436e-99c1-7283ff8c8c04","Type":"ContainerDied","Data":"3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"}
Aug 04 13:23:55.073329 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:55.073306    2574 scope.go:117] "RemoveContainer" containerID="3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"
Aug 04 13:23:55.074549 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:55.074516    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 13:23:55.074620 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:55.074606    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 13:23:55.074663 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:55.074640    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 13:23:56.079517 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:56.079481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" event={"ID":"b81809b3-7dd0-436e-99c1-7283ff8c8c04","Type":"ContainerStarted","Data":"ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde"}
Aug 04 13:23:56.321476 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:56.321438    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:23:56.321728 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:56.321705    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Aug 04 13:23:56.321780 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:56.321755    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Aug 04 13:23:57.321770 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:57.321733    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Aug 04 13:23:57.322187 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:57.321793    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Aug 04 13:23:58.322335 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:58.322292    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Aug 04 13:23:58.322795 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:58.322355    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Aug 04 13:23:59.321512 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:59.321464    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Aug 04 13:23:59.321711 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:23:59.321535    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Aug 04 13:24:00.321523 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:00.321487    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Aug 04 13:24:00.321951 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:00.321557    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Aug 04 13:24:01.325207 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:01.325172    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:24:01.325653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:01.325445    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:24:01.326135 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:01.326119    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:24:10.763669 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.763631    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"]
Aug 04 13:24:10.767026 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.767007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:10.769921 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.769901    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-77ce5c\""
Aug 04 13:24:10.769921 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.769909    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-77ce5c-dockercfg-9l46x\""
Aug 04 13:24:10.778586 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.778560    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"]
Aug 04 13:24:10.882498 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.882441    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"]
Aug 04 13:24:10.886142 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.886119    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:10.897127 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.897095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"]
Aug 04 13:24:10.926849 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.926809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11da3627-8b56-4b68-bca5-3582e2ab0be4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:10.927029 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:10.926860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxtg\" (UniqueName: \"kubernetes.io/projected/11da3627-8b56-4b68-bca5-3582e2ab0be4-kube-api-access-ksxtg\") pod \"payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:11.028179 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.028080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxtg\" (UniqueName: \"kubernetes.io/projected/11da3627-8b56-4b68-bca5-3582e2ab0be4-kube-api-access-ksxtg\") pod \"payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:11.028179 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.028134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl4nl\" (UniqueName: \"kubernetes.io/projected/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-kube-api-access-wl4nl\") pod \"payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.028411 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.028187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.028411 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.028230    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11da3627-8b56-4b68-bca5-3582e2ab0be4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:11.028917 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.028896    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11da3627-8b56-4b68-bca5-3582e2ab0be4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:11.038266 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.038232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxtg\" (UniqueName: \"kubernetes.io/projected/11da3627-8b56-4b68-bca5-3582e2ab0be4-kube-api-access-ksxtg\") pod \"payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:11.077903 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.077865    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:11.129695 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.129656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl4nl\" (UniqueName: \"kubernetes.io/projected/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-kube-api-access-wl4nl\") pod \"payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.129884 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.129773    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.131240 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.130828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.141310 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.141255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl4nl\" (UniqueName: \"kubernetes.io/projected/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-kube-api-access-wl4nl\") pod \"payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.197855 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.197816    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:11.230207 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.230171    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"]
Aug 04 13:24:11.357656 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:11.357624    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"]
Aug 04 13:24:11.359314 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:24:11.359283    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbaed3c_1b1c_4ae2_9716_0e8687e05639.slice/crio-9dea6a7b3b868834a8d503c1bf1ef3dc119ebe80256934796c072f4e78af02fa WatchSource:0}: Error finding container 9dea6a7b3b868834a8d503c1bf1ef3dc119ebe80256934796c072f4e78af02fa: Status 404 returned error can't find the container with id 9dea6a7b3b868834a8d503c1bf1ef3dc119ebe80256934796c072f4e78af02fa
Aug 04 13:24:12.165363 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.165324    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb" event={"ID":"11da3627-8b56-4b68-bca5-3582e2ab0be4","Type":"ContainerStarted","Data":"2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe"}
Aug 04 13:24:12.165868 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.165383    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb" event={"ID":"11da3627-8b56-4b68-bca5-3582e2ab0be4","Type":"ContainerStarted","Data":"047bb2ed3c64014ce065bb1a56a9692cca1a4f86b4c50208f7763cbb0951907e"}
Aug 04 13:24:12.165868 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.165512    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:12.167007 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.166977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt" event={"ID":"ebbaed3c-1b1c-4ae2-9716-0e8687e05639","Type":"ContainerStarted","Data":"6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767"}
Aug 04 13:24:12.167100 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.167012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt" event={"ID":"ebbaed3c-1b1c-4ae2-9716-0e8687e05639","Type":"ContainerStarted","Data":"9dea6a7b3b868834a8d503c1bf1ef3dc119ebe80256934796c072f4e78af02fa"}
Aug 04 13:24:12.167100 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.167033    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:12.186653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.186597    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb" podStartSLOduration=2.186575352 podStartE2EDuration="2.186575352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:24:12.185021833 +0000 UTC m=+3409.708896559" watchObservedRunningTime="2026-08-04 13:24:12.186575352 +0000 UTC m=+3409.710450079"
Aug 04 13:24:12.208365 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:12.208301    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt" podStartSLOduration=2.208284426 podStartE2EDuration="2.208284426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:24:12.207227475 +0000 UTC m=+3409.731102201" watchObservedRunningTime="2026-08-04 13:24:12.208284426 +0000 UTC m=+3409.732159153"
Aug 04 13:24:23.175164 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:23.175085    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:24:23.175164 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:23.175155    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:24:40.843792 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:40.843760    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt_ebbaed3c-1b1c-4ae2-9716-0e8687e05639/payload-processing/0.log"
Aug 04 13:24:43.902864 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.902830    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"]
Aug 04 13:24:43.906793 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.906771    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:43.909930 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.909908    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-2ef922\"/\"openshift-service-ca.crt\""
Aug 04 13:24:43.910459 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.910436    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-2ef922\"/\"kube-root-ca.crt\""
Aug 04 13:24:43.911335 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.911312    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-2ef922\"/\"default-dockercfg-shkf6\""
Aug 04 13:24:43.911483 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.911320    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-2ef922\"/\"ipp-route-2ef922-kserve-self-signed-certs\""
Aug 04 13:24:43.918822 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:43.918798    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"]
Aug 04 13:24:44.018942 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.018903    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-model-cache\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.019145 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.019000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tmp-dir\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.019145 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.019047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-home\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.019278 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.019217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xv8q\" (UniqueName: \"kubernetes.io/projected/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-kube-api-access-6xv8q\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.019343 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.019288    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tls-certs\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.019419 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.019349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-dshm\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120219 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-dshm\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120241    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-model-cache\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120268    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tmp-dir\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120301    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-home\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xv8q\" (UniqueName: \"kubernetes.io/projected/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-kube-api-access-6xv8q\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120470 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tls-certs\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120755 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-model-cache\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120814 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120765    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tmp-dir\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.120814 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.120792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-home\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.122709 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.122687    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-dshm\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.123024 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.123004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tls-certs\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.131320 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.131278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xv8q\" (UniqueName: \"kubernetes.io/projected/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-kube-api-access-6xv8q\") pod \"ipp-route-2ef922-kserve-5c87d7899f-p88gc\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") " pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.217050 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.216950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:44.370922 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:44.370765    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"]
Aug 04 13:24:44.373748 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:24:44.373708    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecc1e8ef_3ba5_459c_98b9_fac31bf8f9f8.slice/crio-f697aec88d1ff037d15d7f740477906bad2571b4004aaee7656814b04752bc4b WatchSource:0}: Error finding container f697aec88d1ff037d15d7f740477906bad2571b4004aaee7656814b04752bc4b: Status 404 returned error can't find the container with id f697aec88d1ff037d15d7f740477906bad2571b4004aaee7656814b04752bc4b
Aug 04 13:24:45.342148 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:45.342113    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc" event={"ID":"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8","Type":"ContainerStarted","Data":"2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1"}
Aug 04 13:24:45.342582 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:45.342156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc" event={"ID":"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8","Type":"ContainerStarted","Data":"f697aec88d1ff037d15d7f740477906bad2571b4004aaee7656814b04752bc4b"}
Aug 04 13:24:45.369523 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:45.369468    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc" podStartSLOduration=2.369452117 podStartE2EDuration="2.369452117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:24:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:24:45.368558145 +0000 UTC m=+3442.892432885" watchObservedRunningTime="2026-08-04 13:24:45.369452117 +0000 UTC m=+3442.893326844"
Aug 04 13:24:54.217724 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:54.217682    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:54.218271 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:54.217743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:54.230774 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:54.230743    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:24:54.400062 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:24:54.400033    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:25:30.890594 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:30.890563    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt_ebbaed3c-1b1c-4ae2-9716-0e8687e05639/payload-processing/0.log"
Aug 04 13:25:36.076964 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.076929    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"]
Aug 04 13:25:36.080530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.080493    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.083109 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.083088    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-b88718-dockercfg-k6rsd\""
Aug 04 13:25:36.083234 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.083107    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-b88718\""
Aug 04 13:25:36.092111 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.092084    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"]
Aug 04 13:25:36.212337 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.212299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qwx\" (UniqueName: \"kubernetes.io/projected/329bc608-2c16-4112-be77-b99d1b18105a-kube-api-access-p9qwx\") pod \"payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.212536 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.212371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329bc608-2c16-4112-be77-b99d1b18105a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.313067 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.313021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qwx\" (UniqueName: \"kubernetes.io/projected/329bc608-2c16-4112-be77-b99d1b18105a-kube-api-access-p9qwx\") pod \"payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.313283 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.313098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329bc608-2c16-4112-be77-b99d1b18105a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.313945 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.313919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329bc608-2c16-4112-be77-b99d1b18105a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.323909 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.323884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qwx\" (UniqueName: \"kubernetes.io/projected/329bc608-2c16-4112-be77-b99d1b18105a-kube-api-access-p9qwx\") pod \"payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.393530 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.393496    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:36.543526 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.543500    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"]
Aug 04 13:25:36.544858 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:25:36.544830    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329bc608_2c16_4112_be77_b99d1b18105a.slice/crio-8dcb5b6386d5c5a2533d3b167cf211a2a136e019797275161df90bbd16d23db0 WatchSource:0}: Error finding container 8dcb5b6386d5c5a2533d3b167cf211a2a136e019797275161df90bbd16d23db0: Status 404 returned error can't find the container with id 8dcb5b6386d5c5a2533d3b167cf211a2a136e019797275161df90bbd16d23db0
Aug 04 13:25:36.598659 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:36.598629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8" event={"ID":"329bc608-2c16-4112-be77-b99d1b18105a","Type":"ContainerStarted","Data":"8dcb5b6386d5c5a2533d3b167cf211a2a136e019797275161df90bbd16d23db0"}
Aug 04 13:25:37.605826 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:37.605784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8" event={"ID":"329bc608-2c16-4112-be77-b99d1b18105a","Type":"ContainerStarted","Data":"a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810"}
Aug 04 13:25:37.606268 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:37.605935    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:25:37.625258 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:37.625207    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8" podStartSLOduration=1.6251930209999998 podStartE2EDuration="1.625193021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 13:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:25:37.624199897 +0000 UTC m=+3495.148074624" watchObservedRunningTime="2026-08-04 13:25:37.625193021 +0000 UTC m=+3495.149067747"
Aug 04 13:25:48.613413 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:25:48.613325    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:26:06.028229 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.028195    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"]
Aug 04 13:26:06.028842 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.028565    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8" podUID="329bc608-2c16-4112-be77-b99d1b18105a" containerName="payload-processing" containerID="cri-o://a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810" gracePeriod=30
Aug 04 13:26:06.290417 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.290336    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:26:06.388297 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.388264    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9qwx\" (UniqueName: \"kubernetes.io/projected/329bc608-2c16-4112-be77-b99d1b18105a-kube-api-access-p9qwx\") pod \"329bc608-2c16-4112-be77-b99d1b18105a\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") "
Aug 04 13:26:06.388550 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.388342    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329bc608-2c16-4112-be77-b99d1b18105a-plugins-config-volume\") pod \"329bc608-2c16-4112-be77-b99d1b18105a\" (UID: \"329bc608-2c16-4112-be77-b99d1b18105a\") "
Aug 04 13:26:06.388761 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.388737    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/329bc608-2c16-4112-be77-b99d1b18105a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "329bc608-2c16-4112-be77-b99d1b18105a" (UID: "329bc608-2c16-4112-be77-b99d1b18105a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:26:06.390700 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.390679    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/329bc608-2c16-4112-be77-b99d1b18105a-kube-api-access-p9qwx" (OuterVolumeSpecName: "kube-api-access-p9qwx") pod "329bc608-2c16-4112-be77-b99d1b18105a" (UID: "329bc608-2c16-4112-be77-b99d1b18105a"). InnerVolumeSpecName "kube-api-access-p9qwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:26:06.489364 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.489328    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9qwx\" (UniqueName: \"kubernetes.io/projected/329bc608-2c16-4112-be77-b99d1b18105a-kube-api-access-p9qwx\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:06.489364 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.489360    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/329bc608-2c16-4112-be77-b99d1b18105a-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:06.758343 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.758307    2574 generic.go:356] "Generic (PLEG): container finished" podID="329bc608-2c16-4112-be77-b99d1b18105a" containerID="a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810" exitCode=0
Aug 04 13:26:06.758554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.758360    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"
Aug 04 13:26:06.758554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.758426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8" event={"ID":"329bc608-2c16-4112-be77-b99d1b18105a","Type":"ContainerDied","Data":"a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810"}
Aug 04 13:26:06.758554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.758492    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8" event={"ID":"329bc608-2c16-4112-be77-b99d1b18105a","Type":"ContainerDied","Data":"8dcb5b6386d5c5a2533d3b167cf211a2a136e019797275161df90bbd16d23db0"}
Aug 04 13:26:06.758554 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.758522    2574 scope.go:117] "RemoveContainer" containerID="a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810"
Aug 04 13:26:06.768295 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.768274    2574 scope.go:117] "RemoveContainer" containerID="a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810"
Aug 04 13:26:06.768616 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:26:06.768596    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810\": container with ID starting with a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810 not found: ID does not exist" containerID="a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810"
Aug 04 13:26:06.768695 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.768627    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810"} err="failed to get container status \"a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810\": rpc error: code = NotFound desc = could not find container \"a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810\": container with ID starting with a1dd030b28b81305e38ddd4d00b77abb3deebc2b70ca743d7af6af21086df810 not found: ID does not exist"
Aug 04 13:26:06.791882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.791853    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"]
Aug 04 13:26:06.807198 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.807165    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-b88718-6c55dbdd8d-rj7w8"]
Aug 04 13:26:06.972622 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:06.972584    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="329bc608-2c16-4112-be77-b99d1b18105a" path="/var/lib/kubelet/pods/329bc608-2c16-4112-be77-b99d1b18105a/volumes"
Aug 04 13:26:38.314474 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:38.314437    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"]
Aug 04 13:26:53.334150 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.334110    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc" podUID="ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" containerName="main" containerID="cri-o://2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1" gracePeriod=45
Aug 04 13:26:53.594534 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.594504    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:26:53.728711 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728679    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-model-cache\") pod \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") "
Aug 04 13:26:53.728882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728731    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-home\") pod \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") "
Aug 04 13:26:53.728882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728753    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-dshm\") pod \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") "
Aug 04 13:26:53.728882 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728820    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xv8q\" (UniqueName: \"kubernetes.io/projected/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-kube-api-access-6xv8q\") pod \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") "
Aug 04 13:26:53.729054 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728905    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tls-certs\") pod \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") "
Aug 04 13:26:53.729054 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tmp-dir\") pod \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\" (UID: \"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8\") "
Aug 04 13:26:53.729054 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.728977    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-model-cache" (OuterVolumeSpecName: "model-cache") pod "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" (UID: "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:26:53.729054 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.729004    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-home" (OuterVolumeSpecName: "home") pod "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" (UID: "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:26:53.729260 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.729179    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-model-cache\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:53.729260 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.729198    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-home\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:53.729260 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.729248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" (UID: "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:26:53.731191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.731167    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-dshm" (OuterVolumeSpecName: "dshm") pod "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" (UID: "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:26:53.731191 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.731177    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" (UID: "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 13:26:53.731356 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.731227    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-kube-api-access-6xv8q" (OuterVolumeSpecName: "kube-api-access-6xv8q") pod "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" (UID: "ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8"). InnerVolumeSpecName "kube-api-access-6xv8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:26:53.830129 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.830098    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-dshm\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:53.830129 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.830126    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xv8q\" (UniqueName: \"kubernetes.io/projected/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-kube-api-access-6xv8q\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:53.830312 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.830138    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tls-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:53.830312 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:53.830148    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8-tmp-dir\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:26:54.000429 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.000327    2574 generic.go:356] "Generic (PLEG): container finished" podID="ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" containerID="2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1" exitCode=0
Aug 04 13:26:54.000429 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.000370    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"
Aug 04 13:26:54.000676 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.000424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc" event={"ID":"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8","Type":"ContainerDied","Data":"2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1"}
Aug 04 13:26:54.000676 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.000469    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc" event={"ID":"ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8","Type":"ContainerDied","Data":"f697aec88d1ff037d15d7f740477906bad2571b4004aaee7656814b04752bc4b"}
Aug 04 13:26:54.000676 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.000489    2574 scope.go:117] "RemoveContainer" containerID="2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1"
Aug 04 13:26:54.009765 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.009743    2574 scope.go:117] "RemoveContainer" containerID="2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1"
Aug 04 13:26:54.010029 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:26:54.010011    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1\": container with ID starting with 2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1 not found: ID does not exist" containerID="2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1"
Aug 04 13:26:54.010081 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.010037    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1"} err="failed to get container status \"2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1\": rpc error: code = NotFound desc = could not find container \"2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1\": container with ID starting with 2dbee0f272ac45dc2080e5b716f37c3ea2e232037ec70b9f7018491191640bb1 not found: ID does not exist"
Aug 04 13:26:54.024276 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.024251    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"]
Aug 04 13:26:54.028864 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.028836    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-2ef922/ipp-route-2ef922-kserve-5c87d7899f-p88gc"]
Aug 04 13:26:54.973093 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:26:54.973063    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" path="/var/lib/kubelet/pods/ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8/volumes"
Aug 04 13:27:23.217647 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:23.217617    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:27:23.222267 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:23.222246    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-88ncj_39dccca5-3465-4b16-b9ed-81ab84241f24/ovn-acl-logging/0.log"
Aug 04 13:27:23.421164 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:23.421135    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"]
Aug 04 13:27:23.421454 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:23.421412    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy" containerID="cri-o://ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde" gracePeriod=30
Aug 04 13:27:28.682342 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.682278    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:27:28.748860 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.748824    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-token\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749029 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.748882    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-envoy\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749029 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.748996    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmdn8\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-kube-api-access-vmdn8\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749117 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749053    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istiod-ca-cert\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749117 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749078    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-podinfo\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749117 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749097    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-certs\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749269 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-credential-socket\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749269 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749162    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-socket\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749269 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749231    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-data\") pod \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\" (UID: \"b81809b3-7dd0-436e-99c1-7283ff8c8c04\") "
Aug 04 13:27:28.749465 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749426    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:27:28.749527 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749496    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:27:28.749731 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749680    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-data" (OuterVolumeSpecName: "istio-data") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:27:28.749731 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749696    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istiod-ca-cert\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.749731 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749722    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-certs\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.750176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749896    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:27:28.750176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.749909    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:27:28.751155 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.751135    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-token" (OuterVolumeSpecName: "istio-token") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:27:28.751581 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.751560    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 13:27:28.751796 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.751772    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 13:27:28.751796 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.751781    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-kube-api-access-vmdn8" (OuterVolumeSpecName: "kube-api-access-vmdn8") pod "b81809b3-7dd0-436e-99c1-7283ff8c8c04" (UID: "b81809b3-7dd0-436e-99c1-7283ff8c8c04"). InnerVolumeSpecName "kube-api-access-vmdn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:27:28.851040 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851003    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-data\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.851040 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851035    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-token\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.851040 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851043    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-envoy\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.851281 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851055    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmdn8\" (UniqueName: \"kubernetes.io/projected/b81809b3-7dd0-436e-99c1-7283ff8c8c04-kube-api-access-vmdn8\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.851281 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851066    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81809b3-7dd0-436e-99c1-7283ff8c8c04-istio-podinfo\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.851281 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851073    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-credential-socket\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:28.851281 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:28.851083    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81809b3-7dd0-436e-99c1-7283ff8c8c04-workload-socket\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:29.185985 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.185949    2574 generic.go:356] "Generic (PLEG): container finished" podID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerID="ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde" exitCode=0
Aug 04 13:27:29.186176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.185998    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"
Aug 04 13:27:29.186176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.186026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" event={"ID":"b81809b3-7dd0-436e-99c1-7283ff8c8c04","Type":"ContainerDied","Data":"ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde"}
Aug 04 13:27:29.186176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.186082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh" event={"ID":"b81809b3-7dd0-436e-99c1-7283ff8c8c04","Type":"ContainerDied","Data":"038639e46baccb1641e16f8076dddbe0f38e76c0fe4941a2687b4d3257d3d07e"}
Aug 04 13:27:29.186870 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.186113    2574 scope.go:117] "RemoveContainer" containerID="ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde"
Aug 04 13:27:29.195995 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.195973    2574 scope.go:117] "RemoveContainer" containerID="3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"
Aug 04 13:27:29.204365 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.204343    2574 scope.go:117] "RemoveContainer" containerID="ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde"
Aug 04 13:27:29.204680 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:27:29.204657    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde\": container with ID starting with ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde not found: ID does not exist" containerID="ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde"
Aug 04 13:27:29.204775 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.204692    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde"} err="failed to get container status \"ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde\": rpc error: code = NotFound desc = could not find container \"ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde\": container with ID starting with ca38daf87d0a34614720eb76f4b195cfe2be6fe3731a931d00b3512d0b667dde not found: ID does not exist"
Aug 04 13:27:29.204775 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.204719    2574 scope.go:117] "RemoveContainer" containerID="3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"
Aug 04 13:27:29.205051 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:27:29.205021    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac\": container with ID starting with 3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac not found: ID does not exist" containerID="3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"
Aug 04 13:27:29.205162 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.205062    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac"} err="failed to get container status \"3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac\": rpc error: code = NotFound desc = could not find container \"3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac\": container with ID starting with 3c32422f53c4512e0c3343f5c9b3b798afac597cf997b597c352d78ba1024fac not found: ID does not exist"
Aug 04 13:27:29.207969 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.207947    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"]
Aug 04 13:27:29.212953 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.212921    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-2ef922-openshift-default-77bd479c4b-phjxh"]
Aug 04 13:27:29.349837 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.349803    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"]
Aug 04 13:27:29.350068 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.350042    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt" podUID="ebbaed3c-1b1c-4ae2-9716-0e8687e05639" containerName="payload-processing" containerID="cri-o://6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767" gracePeriod=30
Aug 04 13:27:29.357800 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.357698    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"]
Aug 04 13:27:29.358058 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.357946    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb" podUID="11da3627-8b56-4b68-bca5-3582e2ab0be4" containerName="payload-pre-processing" containerID="cri-o://2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe" gracePeriod=30
Aug 04 13:27:29.638608 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.638583    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:27:29.641782 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.641763    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:27:29.761124 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.761080    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-plugins-config-volume\") pod \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") "
Aug 04 13:27:29.761581 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.761197    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl4nl\" (UniqueName: \"kubernetes.io/projected/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-kube-api-access-wl4nl\") pod \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\" (UID: \"ebbaed3c-1b1c-4ae2-9716-0e8687e05639\") "
Aug 04 13:27:29.761581 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.761222    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11da3627-8b56-4b68-bca5-3582e2ab0be4-plugins-config-volume\") pod \"11da3627-8b56-4b68-bca5-3582e2ab0be4\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") "
Aug 04 13:27:29.761581 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.761256    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksxtg\" (UniqueName: \"kubernetes.io/projected/11da3627-8b56-4b68-bca5-3582e2ab0be4-kube-api-access-ksxtg\") pod \"11da3627-8b56-4b68-bca5-3582e2ab0be4\" (UID: \"11da3627-8b56-4b68-bca5-3582e2ab0be4\") "
Aug 04 13:27:29.761751 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.761586    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebbaed3c-1b1c-4ae2-9716-0e8687e05639" (UID: "ebbaed3c-1b1c-4ae2-9716-0e8687e05639"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:27:29.761751 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.761611    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11da3627-8b56-4b68-bca5-3582e2ab0be4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "11da3627-8b56-4b68-bca5-3582e2ab0be4" (UID: "11da3627-8b56-4b68-bca5-3582e2ab0be4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:27:29.763477 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.763438    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-kube-api-access-wl4nl" (OuterVolumeSpecName: "kube-api-access-wl4nl") pod "ebbaed3c-1b1c-4ae2-9716-0e8687e05639" (UID: "ebbaed3c-1b1c-4ae2-9716-0e8687e05639"). InnerVolumeSpecName "kube-api-access-wl4nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:27:29.763584 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.763525    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11da3627-8b56-4b68-bca5-3582e2ab0be4-kube-api-access-ksxtg" (OuterVolumeSpecName: "kube-api-access-ksxtg") pod "11da3627-8b56-4b68-bca5-3582e2ab0be4" (UID: "11da3627-8b56-4b68-bca5-3582e2ab0be4"). InnerVolumeSpecName "kube-api-access-ksxtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:27:29.862545 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.862514    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksxtg\" (UniqueName: \"kubernetes.io/projected/11da3627-8b56-4b68-bca5-3582e2ab0be4-kube-api-access-ksxtg\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:29.862545 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.862541    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:29.862545 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.862553    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl4nl\" (UniqueName: \"kubernetes.io/projected/ebbaed3c-1b1c-4ae2-9716-0e8687e05639-kube-api-access-wl4nl\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:29.862779 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:29.862561    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11da3627-8b56-4b68-bca5-3582e2ab0be4-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:30.192567 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.192533    2574 generic.go:356] "Generic (PLEG): container finished" podID="ebbaed3c-1b1c-4ae2-9716-0e8687e05639" containerID="6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767" exitCode=0
Aug 04 13:27:30.192736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.192576    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"
Aug 04 13:27:30.192736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.192615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt" event={"ID":"ebbaed3c-1b1c-4ae2-9716-0e8687e05639","Type":"ContainerDied","Data":"6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767"}
Aug 04 13:27:30.192736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.192673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt" event={"ID":"ebbaed3c-1b1c-4ae2-9716-0e8687e05639","Type":"ContainerDied","Data":"9dea6a7b3b868834a8d503c1bf1ef3dc119ebe80256934796c072f4e78af02fa"}
Aug 04 13:27:30.192736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.192702    2574 scope.go:117] "RemoveContainer" containerID="6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767"
Aug 04 13:27:30.193918 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.193898    2574 generic.go:356] "Generic (PLEG): container finished" podID="11da3627-8b56-4b68-bca5-3582e2ab0be4" containerID="2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe" exitCode=0
Aug 04 13:27:30.194022 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.193931    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"
Aug 04 13:27:30.194022 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.193979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb" event={"ID":"11da3627-8b56-4b68-bca5-3582e2ab0be4","Type":"ContainerDied","Data":"2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe"}
Aug 04 13:27:30.194109 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.194021    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb" event={"ID":"11da3627-8b56-4b68-bca5-3582e2ab0be4","Type":"ContainerDied","Data":"047bb2ed3c64014ce065bb1a56a9692cca1a4f86b4c50208f7763cbb0951907e"}
Aug 04 13:27:30.205289 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.205234    2574 scope.go:117] "RemoveContainer" containerID="6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767"
Aug 04 13:27:30.205656 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:27:30.205628    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767\": container with ID starting with 6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767 not found: ID does not exist" containerID="6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767"
Aug 04 13:27:30.205749 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.205665    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767"} err="failed to get container status \"6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767\": rpc error: code = NotFound desc = could not find container \"6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767\": container with ID starting with 6e88cbf6fea5470490c523df6f4f623d68a47dab6dc254e625e62f1e2cf42767 not found: ID does not exist"
Aug 04 13:27:30.205749 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.205685    2574 scope.go:117] "RemoveContainer" containerID="2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe"
Aug 04 13:27:30.213643 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.213626    2574 scope.go:117] "RemoveContainer" containerID="2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe"
Aug 04 13:27:30.213869 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:27:30.213854    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe\": container with ID starting with 2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe not found: ID does not exist" containerID="2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe"
Aug 04 13:27:30.213930 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.213874    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe"} err="failed to get container status \"2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe\": rpc error: code = NotFound desc = could not find container \"2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe\": container with ID starting with 2b60d5b02b65da0c21273742e31690715f21341c1a511b82936a2f65efd2cfbe not found: ID does not exist"
Aug 04 13:27:30.235736 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.235689    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"]
Aug 04 13:27:30.237655 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.237633    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77ce5c-74dc458d7b-gwtvt"]
Aug 04 13:27:30.253593 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.253570    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"]
Aug 04 13:27:30.256208 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.256158    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77ce5c-655978759b-rmxqb"]
Aug 04 13:27:30.973381 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.973347    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11da3627-8b56-4b68-bca5-3582e2ab0be4" path="/var/lib/kubelet/pods/11da3627-8b56-4b68-bca5-3582e2ab0be4/volumes"
Aug 04 13:27:30.973793 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.973777    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" path="/var/lib/kubelet/pods/b81809b3-7dd0-436e-99c1-7283ff8c8c04/volumes"
Aug 04 13:27:30.974103 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:30.974090    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebbaed3c-1b1c-4ae2-9716-0e8687e05639" path="/var/lib/kubelet/pods/ebbaed3c-1b1c-4ae2-9716-0e8687e05639/volumes"
Aug 04 13:27:48.499352 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.499319    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"]
Aug 04 13:27:48.499865 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.499585    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4" podUID="dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" containerName="payload-processing" containerID="cri-o://174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7" gracePeriod=30
Aug 04 13:27:48.758119 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.758059    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:27:48.839321 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.839286    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc88l\" (UniqueName: \"kubernetes.io/projected/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-kube-api-access-hc88l\") pod \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") "
Aug 04 13:27:48.839321 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.839322    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-plugins-config-volume\") pod \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\" (UID: \"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016\") "
Aug 04 13:27:48.839710 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.839681    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" (UID: "dcd7a3b9-04f5-4887-a992-0b4b0f3a4016"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:27:48.841651 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.841628    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-kube-api-access-hc88l" (OuterVolumeSpecName: "kube-api-access-hc88l") pod "dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" (UID: "dcd7a3b9-04f5-4887-a992-0b4b0f3a4016"). InnerVolumeSpecName "kube-api-access-hc88l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:27:48.940309 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.940271    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc88l\" (UniqueName: \"kubernetes.io/projected/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-kube-api-access-hc88l\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:48.940309 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:48.940307    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:27:49.300316 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.300278    2574 generic.go:356] "Generic (PLEG): container finished" podID="dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" containerID="174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7" exitCode=0
Aug 04 13:27:49.300509 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.300326    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"
Aug 04 13:27:49.300509 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.300330    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4" event={"ID":"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016","Type":"ContainerDied","Data":"174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7"}
Aug 04 13:27:49.300509 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.300383    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4" event={"ID":"dcd7a3b9-04f5-4887-a992-0b4b0f3a4016","Type":"ContainerDied","Data":"9bbedb575e4ccd6cf14a06c1b3c7d4f2a3e11c7dcb4010b89396c1cb95378438"}
Aug 04 13:27:49.300509 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.300458    2574 scope.go:117] "RemoveContainer" containerID="174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7"
Aug 04 13:27:49.308983 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.308964    2574 scope.go:117] "RemoveContainer" containerID="174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7"
Aug 04 13:27:49.309235 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:27:49.309214    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7\": container with ID starting with 174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7 not found: ID does not exist" containerID="174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7"
Aug 04 13:27:49.309283 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.309243    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7"} err="failed to get container status \"174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7\": rpc error: code = NotFound desc = could not find container \"174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7\": container with ID starting with 174111f63a4311f88c8fd88fcd904364c4eb922482d5a65364870b6199d935b7 not found: ID does not exist"
Aug 04 13:27:49.321595 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.321574    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"]
Aug 04 13:27:49.325700 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:49.325680    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-6a00c1-578cfd74d6-9hjz4"]
Aug 04 13:27:50.972367 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:27:50.972329    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" path="/var/lib/kubelet/pods/dcd7a3b9-04f5-4887-a992-0b4b0f3a4016/volumes"
Aug 04 13:28:06.910850 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:06.910814    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"]
Aug 04 13:28:06.911506 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:06.911088    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc" podUID="27238ebb-d8c1-4522-8cd0-4652c693c1be" containerName="payload-processing" containerID="cri-o://b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333" gracePeriod=30
Aug 04 13:28:07.173402 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.173317    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:28:07.298844 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.298808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27238ebb-d8c1-4522-8cd0-4652c693c1be-plugins-config-volume\") pod \"27238ebb-d8c1-4522-8cd0-4652c693c1be\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") "
Aug 04 13:28:07.299057 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.298900    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stv48\" (UniqueName: \"kubernetes.io/projected/27238ebb-d8c1-4522-8cd0-4652c693c1be-kube-api-access-stv48\") pod \"27238ebb-d8c1-4522-8cd0-4652c693c1be\" (UID: \"27238ebb-d8c1-4522-8cd0-4652c693c1be\") "
Aug 04 13:28:07.299268 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.299243    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27238ebb-d8c1-4522-8cd0-4652c693c1be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27238ebb-d8c1-4522-8cd0-4652c693c1be" (UID: "27238ebb-d8c1-4522-8cd0-4652c693c1be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 13:28:07.301136 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.301114    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27238ebb-d8c1-4522-8cd0-4652c693c1be-kube-api-access-stv48" (OuterVolumeSpecName: "kube-api-access-stv48") pod "27238ebb-d8c1-4522-8cd0-4652c693c1be" (UID: "27238ebb-d8c1-4522-8cd0-4652c693c1be"). InnerVolumeSpecName "kube-api-access-stv48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 13:28:07.394938 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.394903    2574 generic.go:356] "Generic (PLEG): container finished" podID="27238ebb-d8c1-4522-8cd0-4652c693c1be" containerID="b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333" exitCode=0
Aug 04 13:28:07.395115 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.394947    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"
Aug 04 13:28:07.395115 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.394975    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc" event={"ID":"27238ebb-d8c1-4522-8cd0-4652c693c1be","Type":"ContainerDied","Data":"b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333"}
Aug 04 13:28:07.395115 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.395017    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc" event={"ID":"27238ebb-d8c1-4522-8cd0-4652c693c1be","Type":"ContainerDied","Data":"ec293e30b0a26803d40789085e3f6ddd60643e0169d71332ed6cc567143f7846"}
Aug 04 13:28:07.395115 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.395038    2574 scope.go:117] "RemoveContainer" containerID="b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333"
Aug 04 13:28:07.399628 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.399606    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27238ebb-d8c1-4522-8cd0-4652c693c1be-plugins-config-volume\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:28:07.399728 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.399629    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stv48\" (UniqueName: \"kubernetes.io/projected/27238ebb-d8c1-4522-8cd0-4652c693c1be-kube-api-access-stv48\") on node \"ip-10-0-132-243.ec2.internal\" DevicePath \"\""
Aug 04 13:28:07.404345 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.404327    2574 scope.go:117] "RemoveContainer" containerID="b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333"
Aug 04 13:28:07.404639 ip-10-0-132-243 kubenswrapper[2574]: E0804 13:28:07.404616    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333\": container with ID starting with b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333 not found: ID does not exist" containerID="b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333"
Aug 04 13:28:07.404718 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.404649    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333"} err="failed to get container status \"b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333\": rpc error: code = NotFound desc = could not find container \"b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333\": container with ID starting with b9abe29c19851e77113b59dacc4607e2b2e62e474f408cb21a68dc5f34b9a333 not found: ID does not exist"
Aug 04 13:28:07.418994 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.418972    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"]
Aug 04 13:28:07.424713 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:07.424666    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c1c995-59cbbc459d-bf2mc"]
Aug 04 13:28:08.972276 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:08.972236    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27238ebb-d8c1-4522-8cd0-4652c693c1be" path="/var/lib/kubelet/pods/27238ebb-d8c1-4522-8cd0-4652c693c1be/volumes"
Aug 04 13:28:19.918943 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:19.918916    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4qfm5_05d4b12a-25ab-4064-b169-3256d47a8f7f/manager/0.log"
Aug 04 13:28:20.032912 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:20.032884    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rspm4_57507218-6147-4a87-99d6-af5fb5fccc89/manager/0.log"
Aug 04 13:28:20.256772 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:20.256673    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7bhvw_8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e/server/0.log"
Aug 04 13:28:20.370465 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:20.370433    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bfzhb_e9015005-308b-47be-a141-bd23512e2ad3/manager/0.log"
Aug 04 13:28:20.620655 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:20.620628    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547f69df5b-89nbm_14f59b07-6929-4e96-b960-ab5452fa84c7/copy-manifests/0.log"
Aug 04 13:28:20.628248 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:20.628219    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547f69df5b-89nbm_14f59b07-6929-4e96-b960-ab5452fa84c7/manager/0.log"
Aug 04 13:28:21.519062 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:21.519030    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tl7vj_a67db812-6263-4dda-a58e-715a4fc8b171/postgres/0.log"
Aug 04 13:28:22.391433 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:22.391402    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-42b2f_7fb3499a-d3d0-4580-85a8-583a32bd74d3/manager/0.log"
Aug 04 13:28:22.495652 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:22.495619    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-rh6sm_03a50576-4d27-4c9f-8554-d708b59a1e20/manager/0.log"
Aug 04 13:28:22.717680 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:22.717608    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-mz6p2_637d172d-fc69-4eac-abd7-aedaa5dc2272/manager/0.log"
Aug 04 13:28:22.958932 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:22.958905    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-88ghd_f380e101-b725-41fb-ac28-0fbff76182f4/manager/0.log"
Aug 04 13:28:23.298479 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:23.298444    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd_c4306c4b-2289-4942-98d6-8263b7a479a0/istio-proxy/0.log"
Aug 04 13:28:23.547499 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:23.547472    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5688595d9d-htlq7_fcfd4d16-6fb7-4538-acad-9a6e4519d12f/kube-auth-proxy/0.log"
Aug 04 13:28:23.776246 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:23.776217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/1.log"
Aug 04 13:28:23.889892 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:23.889851    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bnz59_5e3f26f2-46ed-449d-b7ff-5c9a05898e70/payload-pre-processing/0.log"
Aug 04 13:28:24.670848 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:24.670822    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hsh4s_6e509945-fa27-474f-9498-43fd28ea5d63/main/0.log"
Aug 04 13:28:24.890657 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:24.890616    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zg6xc_67e32736-9f39-4d91-98c3-d29aaf3f4fc4/main/0.log"
Aug 04 13:28:25.002615 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:25.002510    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-lb9mk_942e2bf2-5ffa-4d24-98f5-4b75e1d6e02f/main/0.log"
Aug 04 13:28:33.501660 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:33.501633    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5sct2_e6d05309-a5b9-4a01-878e-e4000488b9c5/global-pull-secret-syncer/0.log"
Aug 04 13:28:33.743555 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:33.743523    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ktqrt_21f4896a-2f32-432f-8beb-29c8c18c8f47/konnectivity-agent/0.log"
Aug 04 13:28:33.768376 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:33.768315    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-243.ec2.internal_0e5018d200709bf17205fbeb9a1858db/haproxy/0.log"
Aug 04 13:28:38.632035 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:38.631997    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-42b2f_7fb3499a-d3d0-4580-85a8-583a32bd74d3/manager/0.log"
Aug 04 13:28:38.677106 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:38.677076    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-rh6sm_03a50576-4d27-4c9f-8554-d708b59a1e20/manager/0.log"
Aug 04 13:28:38.814177 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:38.814140    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-mz6p2_637d172d-fc69-4eac-abd7-aedaa5dc2272/manager/0.log"
Aug 04 13:28:38.926157 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:38.926066    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-88ghd_f380e101-b725-41fb-ac28-0fbff76182f4/manager/0.log"
Aug 04 13:28:41.006620 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:41.006575    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-72vn5_a690ca01-6389-440d-a7a4-482bcace4edb/node-exporter/0.log"
Aug 04 13:28:41.040157 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:41.040137    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-72vn5_a690ca01-6389-440d-a7a4-482bcace4edb/kube-rbac-proxy/0.log"
Aug 04 13:28:41.080006 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:41.079981    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-72vn5_a690ca01-6389-440d-a7a4-482bcace4edb/init-textfile/0.log"
Aug 04 13:28:43.994199 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994115    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"]
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994503    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27238ebb-d8c1-4522-8cd0-4652c693c1be" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994516    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="27238ebb-d8c1-4522-8cd0-4652c693c1be" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994526    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994532    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994539    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994545    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994551    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11da3627-8b56-4b68-bca5-3582e2ab0be4" containerName="payload-pre-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994556    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="11da3627-8b56-4b68-bca5-3582e2ab0be4" containerName="payload-pre-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994567    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" containerName="main"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994573    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" containerName="main"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994580    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994585    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994592    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329bc608-2c16-4112-be77-b99d1b18105a" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994598    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="329bc608-2c16-4112-be77-b99d1b18105a" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994605    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebbaed3c-1b1c-4ae2-9716-0e8687e05639" containerName="payload-processing"
Aug 04 13:28:43.994605 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994610    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebbaed3c-1b1c-4ae2-9716-0e8687e05639" containerName="payload-processing"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994665    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd7a3b9-04f5-4887-a992-0b4b0f3a4016" containerName="payload-processing"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994672    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="27238ebb-d8c1-4522-8cd0-4652c693c1be" containerName="payload-processing"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994679    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="11da3627-8b56-4b68-bca5-3582e2ab0be4" containerName="payload-pre-processing"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994684    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc1e8ef-3ba5-459c-98b9-fac31bf8f9f8" containerName="main"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994689    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994696    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="329bc608-2c16-4112-be77-b99d1b18105a" containerName="payload-processing"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994701    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b81809b3-7dd0-436e-99c1-7283ff8c8c04" containerName="istio-proxy"
Aug 04 13:28:43.995176 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.994707    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebbaed3c-1b1c-4ae2-9716-0e8687e05639" containerName="payload-processing"
Aug 04 13:28:43.997721 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:43.997704    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.002325 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.002296    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kqx2z\"/\"default-dockercfg-6pz8c\""
Aug 04 13:28:44.002653 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.002627    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kqx2z\"/\"openshift-service-ca.crt\""
Aug 04 13:28:44.002774 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.002657    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kqx2z\"/\"kube-root-ca.crt\""
Aug 04 13:28:44.011294 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.011267    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"]
Aug 04 13:28:44.108718 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.108678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-sys\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.108889 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.108831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7sqw\" (UniqueName: \"kubernetes.io/projected/2a03aabe-3fb4-4911-9efa-7645ad00c72f-kube-api-access-g7sqw\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.108889 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.108865    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-lib-modules\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.108889 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.108883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-proc\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.109001 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.108944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-podres\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.209997 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.209962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7sqw\" (UniqueName: \"kubernetes.io/projected/2a03aabe-3fb4-4911-9efa-7645ad00c72f-kube-api-access-g7sqw\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.209997 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210000    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-lib-modules\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-proc\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-podres\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-sys\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-sys\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210241 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-podres\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210451 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-proc\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.210451 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.210142    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a03aabe-3fb4-4911-9efa-7645ad00c72f-lib-modules\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.220544 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.220525    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7sqw\" (UniqueName: \"kubernetes.io/projected/2a03aabe-3fb4-4911-9efa-7645ad00c72f-kube-api-access-g7sqw\") pod \"perf-node-gather-daemonset-qgffz\" (UID: \"2a03aabe-3fb4-4911-9efa-7645ad00c72f\") " pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.306880 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.306803    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.437358 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.437336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"]
Aug 04 13:28:44.439449 ip-10-0-132-243 kubenswrapper[2574]: W0804 13:28:44.439422    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2a03aabe_3fb4_4911_9efa_7645ad00c72f.slice/crio-e792c77850bad0d3523a0cf613e9cfda708e618cb3710d8289b037ef67f84a88 WatchSource:0}: Error finding container e792c77850bad0d3523a0cf613e9cfda708e618cb3710d8289b037ef67f84a88: Status 404 returned error can't find the container with id e792c77850bad0d3523a0cf613e9cfda708e618cb3710d8289b037ef67f84a88
Aug 04 13:28:44.574433 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.574344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz" event={"ID":"2a03aabe-3fb4-4911-9efa-7645ad00c72f","Type":"ContainerStarted","Data":"ca50090af154b73805b09adc2f484ad8cfd2ca09ee6d770a80285991a7b75a2c"}
Aug 04 13:28:44.574433 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.574415    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz" event={"ID":"2a03aabe-3fb4-4911-9efa-7645ad00c72f","Type":"ContainerStarted","Data":"e792c77850bad0d3523a0cf613e9cfda708e618cb3710d8289b037ef67f84a88"}
Aug 04 13:28:44.574640 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.574448    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:44.594791 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:44.594746    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz" podStartSLOduration=1.594728193 podStartE2EDuration="1.594728193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 13:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 13:28:44.592769037 +0000 UTC m=+3682.116643765" watchObservedRunningTime="2026-08-04 13:28:44.594728193 +0000 UTC m=+3682.118602920"
Aug 04 13:28:46.722678 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:46.722644    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wmttw_7165c480-84bc-4f40-b6e1-443cf606bf88/dns/0.log"
Aug 04 13:28:46.756363 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:46.756338    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wmttw_7165c480-84bc-4f40-b6e1-443cf606bf88/kube-rbac-proxy/0.log"
Aug 04 13:28:46.820599 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:46.820574    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-87dc2_6281c301-ef47-422b-98a5-290e9a7cffd0/dns-node-resolver/0.log"
Aug 04 13:28:47.530922 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:47.530884    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65fd976cf7-ds9ts_f02ea687-e2ac-4e35-a97d-bbe636c264e7/registry/0.log"
Aug 04 13:28:47.634128 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:47.634095    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sggfd_7c92c6f0-85a8-4660-92c7-5e9227510d32/node-ca/0.log"
Aug 04 13:28:48.722777 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:48.722744    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd_c4306c4b-2289-4942-98d6-8263b7a479a0/istio-proxy/0.log"
Aug 04 13:28:49.072583 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:49.072495    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5688595d9d-htlq7_fcfd4d16-6fb7-4538-acad-9a6e4519d12f/kube-auth-proxy/0.log"
Aug 04 13:28:49.140007 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:49.139984    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/0.log"
Aug 04 13:28:49.146731 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:49.146708    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/1.log"
Aug 04 13:28:49.190189 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:49.190165    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bnz59_5e3f26f2-46ed-449d-b7ff-5c9a05898e70/payload-pre-processing/0.log"
Aug 04 13:28:50.098846 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:50.098815    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4ktrj_65e9e685-8283-408b-9305-28b3216b4768/serve-healthcheck-canary/0.log"
Aug 04 13:28:50.589183 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:50.589159    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kqx2z/perf-node-gather-daemonset-qgffz"
Aug 04 13:28:50.793102 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:50.793075    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d2lqj_cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6/kube-rbac-proxy/0.log"
Aug 04 13:28:50.820024 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:50.819999    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d2lqj_cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6/exporter/0.log"
Aug 04 13:28:50.847277 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:50.847217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d2lqj_cfbf5d96-56e0-4342-9ab1-ee6a7e2720e6/extractor/0.log"
Aug 04 13:28:53.227155 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:53.227123    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4qfm5_05d4b12a-25ab-4064-b169-3256d47a8f7f/manager/0.log"
Aug 04 13:28:53.448290 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:53.448256    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rspm4_57507218-6147-4a87-99d6-af5fb5fccc89/manager/0.log"
Aug 04 13:28:53.722081 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:53.722054    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7bhvw_8f79d0b7-0b5c-4b13-8a51-b0a65cdb747e/server/0.log"
Aug 04 13:28:53.809004 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:53.808982    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bfzhb_e9015005-308b-47be-a141-bd23512e2ad3/manager/0.log"
Aug 04 13:28:54.020815 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:54.020795    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547f69df5b-89nbm_14f59b07-6929-4e96-b960-ab5452fa84c7/manager/0.log"
Aug 04 13:28:54.057025 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:54.057000    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547f69df5b-89nbm_14f59b07-6929-4e96-b960-ab5452fa84c7/copy-manifests/0.log"
Aug 04 13:28:54.780760 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:54.780721    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd_c4306c4b-2289-4942-98d6-8263b7a479a0/istio-proxy/0.log"
Aug 04 13:28:55.141997 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:55.141973    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5688595d9d-htlq7_fcfd4d16-6fb7-4538-acad-9a6e4519d12f/kube-auth-proxy/0.log"
Aug 04 13:28:55.208464 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:55.208437    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/0.log"
Aug 04 13:28:55.214585 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:55.214564    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/1.log"
Aug 04 13:28:55.239502 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:55.239477    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bnz59_5e3f26f2-46ed-449d-b7ff-5c9a05898e70/payload-pre-processing/0.log"
Aug 04 13:28:56.750224 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:56.750191    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-d9dfd_c4306c4b-2289-4942-98d6-8263b7a479a0/istio-proxy/0.log"
Aug 04 13:28:57.089851 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:57.089830    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5688595d9d-htlq7_fcfd4d16-6fb7-4538-acad-9a6e4519d12f/kube-auth-proxy/0.log"
Aug 04 13:28:57.135094 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:57.135059    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/0.log"
Aug 04 13:28:57.141619 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:57.141596    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nfjzz_afb269bc-1015-43cc-b3bd-043ddf07962e/istio-proxy/1.log"
Aug 04 13:28:57.162741 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:28:57.162717    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bnz59_5e3f26f2-46ed-449d-b7ff-5c9a05898e70/payload-pre-processing/0.log"
Aug 04 13:29:00.847903 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:00.847872    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-bqfmh_3625ffe9-3ad5-4416-91f6-234238685caf/migrator/0.log"
Aug 04 13:29:00.874678 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:00.874651    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-bqfmh_3625ffe9-3ad5-4416-91f6-234238685caf/graceful-termination/0.log"
Aug 04 13:29:02.358629 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.358597    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8mwcw_fa507e95-6d53-4523-8af5-1bd766f7c5cf/kube-multus/0.log"
Aug 04 13:29:02.823441 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.823344    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/kube-multus-additional-cni-plugins/0.log"
Aug 04 13:29:02.853762 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.853733    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/egress-router-binary-copy/0.log"
Aug 04 13:29:02.880101 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.880075    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/cni-plugins/0.log"
Aug 04 13:29:02.906338 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.906308    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/bond-cni-plugin/0.log"
Aug 04 13:29:02.931220 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.931192    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/routeoverride-cni/0.log"
Aug 04 13:29:02.959349 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.959318    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/whereabouts-cni-bincopy/0.log"
Aug 04 13:29:02.985410 ip-10-0-132-243 kubenswrapper[2574]: I0804 13:29:02.985363    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5tzv_74cc9684-d953-4ee6-8e00-be68daddd2eb/whereabouts-cni/0.log"